Jul 15 23:35:54.331783 ip-10-0-133-3 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.788598    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794608    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794624    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794630    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794634    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794638    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794642    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794646    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:54.940939 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794650    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:54.866313 ip-10-0-133-3 systemd[1]: Started Kubernetes Kubelet.
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794654    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794657    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794661    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794667    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794672    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794676    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794682    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794688    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794692    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794696    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794703    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794707    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794712    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794718    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794722    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794727    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794731    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794735    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.092959 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794738    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794743    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794747    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794775    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794781    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794786    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794791    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794801    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794805    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794808    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794811    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794814    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794816    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794819    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794822    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794825    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794828    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794830    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794833    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.094543 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794835    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794838    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794841    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794843    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794846    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794848    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794851    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794854    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794856    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794859    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794861    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794866    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794868    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794871    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794874    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794877    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794880    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794882    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794885    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794888    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.096600 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794892    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794896    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794900    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794904    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794908    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794911    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794916    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794920    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794924    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794928    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794932    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794936    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794939    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794944    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794948    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794952    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794957    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794961    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794966    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794970    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.098361 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794974    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794977    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794981    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794985    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794988    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794992    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.794996    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795000    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795004    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795007    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795011    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795014    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795018    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.795022    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796049    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796058    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796063    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796069    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796075    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796081    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.099593 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796085    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796089    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796093    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796097    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796101    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796105    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796110    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796114    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796118    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796122    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796126    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796129    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796133    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796138    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796141    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796144    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796146    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796149    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796151    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796154    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.100226 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796156    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796159    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796161    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796164    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796168    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796170    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796173    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796175    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796178    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796181    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796183    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796186    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796191    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796195    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796198    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796201    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796204    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796206    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796209    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796211    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.100847 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796214    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796216    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796219    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796221    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796223    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796226    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796228    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796231    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796233    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796236    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796240    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796243    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796245    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796248    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796250    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796254    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796257    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796261    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796264    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.101542 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796267    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796269    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796272    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796275    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796277    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796280    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796283    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796286    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796288    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796291    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796295    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796297    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796300    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796303    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796305    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796308    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796310    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796313    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796315    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796318    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.102088 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796321    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796323    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796326    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796329    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796331    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796335    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796338    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796340    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796343    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796345    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796348    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796351    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796353    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796356    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796762    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796768    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796771    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796773    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796781    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796784    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.102717 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796788    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796791    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796793    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796796    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796799    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796801    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796804    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796807    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796809    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796812    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796815    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796817    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796820    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796823    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796826    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796829    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796831    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796834    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796837    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796839    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.103288 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796841    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796844    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796846    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796849    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796852    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796855    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796857    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796862    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796866    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796869    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796872    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796875    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796878    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796880    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796883    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796886    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796888    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796891    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796893    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.103907 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796896    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796898    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796901    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796903    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796906    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796908    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796911    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796913    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796915    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796923    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796926    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796929    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796932    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796936    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796940    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796943    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796945    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796950    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796953    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.104506 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796956    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796958    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796961    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796963    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796966    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796969    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796972    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796974    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796977    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796980    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796983    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796985    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796988    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796990    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796993    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796995    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.796997    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797001    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797004    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797006    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.105089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797009    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797011    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797015    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797018    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797020    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797023    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797025    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797028    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797030    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797033    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797036    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797039    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797042    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797044    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797047    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797120    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797127    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797133    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797138    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797143    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797147    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 23:35:55.105635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797151    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797155    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797158    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797161    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797165    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797168    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797171    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797174    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797185    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797189    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797191    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797195    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797200    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797205    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797208    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797211    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797214    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797219    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797222    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797225    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797228    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797233    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797236    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797239    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 23:35:55.106222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797242    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797245    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797249    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797252    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797255    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797258    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797261    2578 flags.go:64] FLAG: --enable-server="true"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797264    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797268    2578 flags.go:64] FLAG: --event-burst="100"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797272    2578 flags.go:64] FLAG: --event-qps="50"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797275    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797278    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797281    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797284    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797287    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797290    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797293    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797296    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797298    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797301    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797304    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797309    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797312    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797315    2578 flags.go:64] FLAG: --feature-gates=""
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797319    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 23:35:55.106949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797322    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797325    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797328    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797331    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797335    2578 flags.go:64] FLAG: --help="false"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797338    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797341    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797344    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797347    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797351    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797354    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797358    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797360    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797363    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797366    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797370    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797373    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797376    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797379    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797381    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797384    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797387    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797390    2578 flags.go:64] FLAG: --lock-file=""
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797393    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 23:35:55.107655 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797395    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797398    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797404    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797406    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797411    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797414    2578 flags.go:64] FLAG: --logging-format="text"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797416    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797420    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797422    2578 flags.go:64] FLAG: --manifest-url=""
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797425    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797430    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797433    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797439    2578 flags.go:64] FLAG: --max-pods="110"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797442    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797445    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797448    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797450    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797453    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797456    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797459    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797466    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797469    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797473    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 23:35:55.108599 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797476    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797479    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797484    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797487    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797505    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797508    2578 flags.go:64] FLAG: --port="10250"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797511    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797514    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0352da23fed077b97"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797517    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797520    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797523    2578 flags.go:64] FLAG: --register-node="true"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797526    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797530    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797535    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797537    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797540    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797544    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797547    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797550    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797553    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797556    2578 flags.go:64] FLAG: --runonce="false"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797559    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797564    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797567    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797570    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 23:35:55.109283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797573    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797576    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797579    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797582    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797585    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797588    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797591    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797594    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797597    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797601    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797604    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797609    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797612    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797615    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797619    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797622    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797624    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797627    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797630    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797633    2578 flags.go:64] FLAG: --v="2"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797639    2578 flags.go:64] FLAG: --version="false"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797643    2578 flags.go:64] FLAG: --vmodule=""
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797647    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.797650    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797776    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:55.285256 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797779    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797783    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797786    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797789    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797794    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797797    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797800    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797802    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797805    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797808    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797810    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797813    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797815    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797818    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797820    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797823    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797825    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797828    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797831    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797833    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.286232 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797836    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797839    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797841    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797844    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797846    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797849    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797851    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797855    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797858    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797860    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797862    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797865    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797867    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797870    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797873    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797875    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797879    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797882    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797886    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797889    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.286879 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797893    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797896    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797899    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797902    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797904    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797907    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797910    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797912    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797916    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797919    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797923    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797926    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797929    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797931    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797934    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797936    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797939    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797941    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797944    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.287444 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797952    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797954    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797957    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797960    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797962    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797964    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797967    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797969    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797972    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797976    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797980    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797984    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797987    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797990    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797992    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797995    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.797998    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798001    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798003    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.287956 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798006    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798009    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798012    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798014    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798017    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798020    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798022    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798025    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798027    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798030    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798032    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798035    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798037    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798041    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798043    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798046    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798049    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798051    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798053    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.288505 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.798056    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.798062    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.806274    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.806291    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.806313    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.806320    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806377    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806382    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806386    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806389    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806392    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806395    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806400    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806404    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.289013 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806407    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806414    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806416    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806419    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806422    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806425    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806428    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806431    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806433    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806436    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806438    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806441    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806445    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806448    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806452    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806455    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806458    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806461    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806464    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806467    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:55.289449 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806470    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806473    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806476    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806478    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806481    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806484    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806486    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806505    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806510    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806513    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806515    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806518    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806521    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806524    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806527    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806530    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806532    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806535    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806538    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806540    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.290007 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806543    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806545    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806548    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806551    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806555    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806558    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806561    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806564    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806567    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806570    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806573    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806575    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806578    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806581    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806585    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806588    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806590    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806593    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806596    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.290571 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806598    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806602    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806605    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806607    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806610    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806613    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806617    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806619    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806622    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806624    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806627    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806630    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806633    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806635    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806638    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806641    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806643    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806646    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806648    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806651    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.291067 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806654    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806657    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806659    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806662    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806664    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806667    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806669    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806672    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806675    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806677    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806680    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806683    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.806688    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806815    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806820    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:35:55.291649 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806824    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806827    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806830    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806833    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806837    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806840    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806843    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806845    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806848    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806851    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806854    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806857    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806859    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806862    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806865    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806867    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806870    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806872    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806875    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806878    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:35:55.292062 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806880    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806883    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806885    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806888    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806891    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806893    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806896    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806899    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806902    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806904    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806908    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806911    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806914    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806916    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806918    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806921    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806925    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806929    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806932    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:35:55.292619 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806935    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806937    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806940    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806942    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806945    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806947    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806950    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806953    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806955    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806958    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806960    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806963    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806965    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806968    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806970    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806973    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806975    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806978    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806980    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806983    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:35:55.293125 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806986    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806988    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806991    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806995    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.806998    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807000    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807003    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807005    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807007    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807011    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807014    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807018    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807021    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807024    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807027    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807031    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807034    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807037    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807040    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:35:55.293728 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807042    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807045    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807048    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807050    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807053    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807055    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807058    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807061    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807064    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807066    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807069    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807071    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807074    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807077    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807080    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807082    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807086    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807088    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:35:55.294259 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:54.807091    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.807096    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.807214    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.811191    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.812858    2578 server.go:1019] "Starting client certificate rotation"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.812955    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.812987    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.815679    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.816804    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.828703    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.831309    2578 log.go:25] "Validated CRI v1 image API"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.832884    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 23:35:55.294791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.836009    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 da138dd5-9fdf-4399-9b15-26486bc84851:/dev/nvme0n1p4 e59135fb-9c5e-4547-868b-67819963d490:/dev/nvme0n1p3]
Jul 15 23:35:55.295137 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.836031    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.841043    2578 manager.go:216] Machine: {Timestamp:2026-07-15 23:35:54.839616417 +0000 UTC m=+0.371445396 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099754 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20406e615c609a4db9e9fbf7b88eba SystemUUID:ec20406e-615c-609a-4db9-e9fbf7b88eba BootID:afde12b7-2f75-4cb8-83da-5a8a6b74ae8d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:1f:cf:52:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:1f:cf:52:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:b2:5d:e2:73:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.841151    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.841241    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.844413    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.844697    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.844725    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 23:35:55.295239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.846322    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.846334    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.846342    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.847077    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.848911    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852224    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852343    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852372    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852387    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852401    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852416    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.852429    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.854616    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.854658    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.857421    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860098    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860126    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860271    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860283    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860288    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860293    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860301    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860306    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860969    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860975    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860982    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860988    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.860996    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.861004    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.861943    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.861950    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.864704    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.864924    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.864972    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.865374    2578 server.go:1268] "Started kubelet"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.865722    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.865747    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.865813    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.867528    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.869314    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-td226"
Jul 15 23:35:55.295824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.869853    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.871281    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.872646    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-3.ec2.internal.18c29ac0b5b920f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-3.ec2.internal,UID:ip-10-0-133-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-3.ec2.internal,},FirstTimestamp:2026-07-15 23:35:54.865344759 +0000 UTC m=+0.397173792,LastTimestamp:2026-07-15 23:35:54.865344759 +0000 UTC m=+0.397173792,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-3.ec2.internal,}"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.875772    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-td226"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876111    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876121    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.876207    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876805    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876823    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876811    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876889    2578 factory.go:55] Registering systemd factory
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876904    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876932    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.876940    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877126    2578 factory.go:153] Registering CRI-O factory
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877140    2578 factory.go:223] Registration of the crio container factory successfully
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877200    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877224    2578 factory.go:103] Registering Raw factory
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877244    2578 manager.go:1196] Started watching for new ooms in manager
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.877770    2578 manager.go:349] Starting recovery of all containers
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.879971    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.879981    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.888092    2578 manager.go:354] Recovery completed
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.894660    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896375    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896403    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896413    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896908    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896920    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896938    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.896920    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.897617    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.482199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.897642    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.897652    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.898122    2578 policy_none.go:49] "None policy: Start"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.898134    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.898143    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.899103    2578 policy_none.go:47] "Start"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959033    2578 manager.go:337] "Starting Device Plugin manager"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.959113    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959127    2578 server.go:87] "Starting device plugin registration server"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959386    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959398    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959509    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959589    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.959600    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.960127    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.960171    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.988588    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.989732    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.989767    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.989793    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:54.989825    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:54.991435    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.060067    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.061018    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.061046    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.061058    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.061081    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.069368    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.069388    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-3.ec2.internal\": node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.081122    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.089899    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"]
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.089956    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.090838    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.090862    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.090874    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092211    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092341    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.485585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092909    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092913    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092935    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092951    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092950    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.092995    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.094173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.094194    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.095899    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.095926    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.095937    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.146276    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-3.ec2.internal\" not found" node="ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.150806    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-3.ec2.internal\" not found" node="ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.177752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.177775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dbbb0615f3fefa38a3af027c8dc6b0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-3.ec2.internal\" (UID: \"dbbb0615f3fefa38a3af027c8dc6b0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.177792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.181716    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dbbb0615f3fefa38a3af027c8dc6b0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-3.ec2.internal\" (UID: \"dbbb0615f3fefa38a3af027c8dc6b0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.486642 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d3766cd9655156bf277457faa9cb8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal\" (UID: \"38d3766cd9655156bf277457faa9cb8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.277993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dbbb0615f3fefa38a3af027c8dc6b0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-3.ec2.internal\" (UID: \"dbbb0615f3fefa38a3af027c8dc6b0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.282480    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.383356    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.448547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.454926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:55.487230 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.483910    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.679210 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.584403    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.684852    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.785214    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.813464    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.813626    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.879178    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 23:30:55 +0000 UTC" deadline="2028-01-23 04:01:52.861022144 +0000 UTC"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.879214    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13348h25m56.981811278s"
Jul 15 23:35:55.906696 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:55.885449    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-3.ec2.internal\" not found"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.947131    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.947907    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.976724    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.988267    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.990348    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal"
Jul 15 23:35:56.136909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:55.999090    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:35:56.341366 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.199985    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:35:56.580937 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.388241    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:35:56.743308 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.732978    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.855064    2578 apiserver.go:52] "Watching apiserver"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.860790    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.863063    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq","openshift-multus/multus-additional-cni-plugins-cc8n7","openshift-multus/multus-g6njm","openshift-multus/network-metrics-daemon-qhc56","openshift-network-diagnostics/network-check-target-ssmhf","openshift-network-operator/iptables-alerter-hk9h8","kube-system/konnectivity-agent-tzgm7","openshift-cluster-node-tuning-operator/tuned-57lgf","openshift-dns/node-resolver-cbzgm","openshift-image-registry/node-ca-f9bzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-npzts","kube-system/global-pull-secret-syncer-kj9l7"]
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.864681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.866523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.867823    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.868028    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.868217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fhdk4\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.868416    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.869160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.869234    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.869367    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2rjbp\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.870659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.871373    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.871552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.871816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.871986    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.872090    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.873043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.873922    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.874159    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r6kl2\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.874214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.874312    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.874401    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.874524    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.876388    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 23:35:56.895348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.876411    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.876852    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.877094    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.878521    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.878953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.879036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.879288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvrpp\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.880204    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.880553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cxpb\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.881084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.881150    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.883005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.885282    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.885485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.885997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rh7fc\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886239    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-script-lib\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-k8s-cni-cncf-io\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.897086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.886998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-tuned\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-bin\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-etc-kubernetes\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-conf\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-system-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-cni-binary-copy\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gsf\" (UniqueName: \"kubernetes.io/projected/298966ad-fea8-49d8-8b61-55b075cb6704-kube-api-access-b7gsf\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zmh9\" (UniqueName: \"kubernetes.io/projected/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-kube-api-access-5zmh9\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysconfig\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-kubelet\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-slash\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-ovn\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-log-socket\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.898788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-hostroot\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-kubernetes\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-cnibin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-systemd\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-tmp\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6nc2\" (UniqueName: \"kubernetes.io/projected/9cf49879-4dc7-4d01-b8ff-8ff657918c95-kube-api-access-g6nc2\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-dbus\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-systemd-units\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-env-overrides\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-etc-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-os-release\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.899960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-host\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzlhm\" (UniqueName: \"kubernetes.io/projected/f08933b4-ce91-403c-92e9-49b0ba0319a5-kube-api-access-nzlhm\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-kubelet\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-socket-dir-parent\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-netns\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-multus-daemon-config\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-config\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovn-node-metrics-cert\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.902081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.887997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-var-lib-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-node-log\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-system-cni-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bfa8164-c387-4127-aedd-fee373b2281b-iptables-alerter-script\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-bin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-multus-certs\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-sys\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-lib-modules\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-os-release\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-netns\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cnibin\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pnqt\" (UniqueName: \"kubernetes.io/projected/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-kube-api-access-5pnqt\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bfa8164-c387-4127-aedd-fee373b2281b-host-slash\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:56.903041 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-modprobe-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-run\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-var-lib-kubelet\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-kubelet-config\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-systemd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p49sg\" (UniqueName: \"kubernetes.io/projected/6bfa8164-c387-4127-aedd-fee373b2281b-kube-api-access-p49sg\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-multus\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-conf-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.888516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-netd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.890281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.890429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x5rvq\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.890759    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.891276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.891600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.893496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.894697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.894884    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.895058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nzzzp\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.895468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hc2cn\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.895620    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.896064    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 23:35:56.904244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.898316    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:35:56.918733 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.917442    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bm526"
Jul 15 23:35:56.984194 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.927807    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bm526"
Jul 15 23:35:56.984194 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.977702    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-tuned\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-bin\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-etc-kubernetes\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-conf\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-sys-fs\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-system-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-cni-binary-copy\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gsf\" (UniqueName: \"kubernetes.io/projected/298966ad-fea8-49d8-8b61-55b075cb6704-kube-api-access-b7gsf\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zmh9\" (UniqueName: \"kubernetes.io/projected/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-kube-api-access-5zmh9\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc96ad5-da20-485b-87e1-bb21d8703401-agent-certs\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysconfig\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-kubelet\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.989392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-slash\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-ovn\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-log-socket\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-hostroot\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-kubernetes\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-cnibin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-systemd\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-tmp\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6nc2\" (UniqueName: \"kubernetes.io/projected/9cf49879-4dc7-4d01-b8ff-8ff657918c95-kube-api-access-g6nc2\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-dbus\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-systemd-units\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.990612 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.989864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-env-overrides\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-etc-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-os-release\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-host\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-socket-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzlhm\" (UniqueName: \"kubernetes.io/projected/f08933b4-ce91-403c-92e9-49b0ba0319a5-kube-api-access-nzlhm\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-kubelet\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:56.994715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5q7\" (UniqueName: \"kubernetes.io/projected/040f26c4-7552-482d-8f38-69ea79e0b858-kube-api-access-qh5q7\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-os-release\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-kubelet\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-host\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-bin\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-etc-kubernetes\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.994945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-etc-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysctl-conf\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-kubelet\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-env-overrides\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995373    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-sysconfig\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-cnibin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-slash\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.996150 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-hostroot\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-kubernetes\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-log-socket\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-systemd\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-systemd-units\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-dbus\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.995891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-ovn\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-socket-dir-parent\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-netns\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-multus-daemon-config\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.997371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-device-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-config\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovn-node-metrics-cert\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-var-lib-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-node-log\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-system-cni-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bfa8164-c387-4127-aedd-fee373b2281b-iptables-alerter-script\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-bin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-multus-certs\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-sys\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-lib-modules\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-os-release\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:56.999681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-bin\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-etc-selinux\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-multus-certs\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7zj\" (UniqueName: \"kubernetes.io/projected/d345a3d2-5478-4345-9daa-42b4716eca38-kube-api-access-jl7zj\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-sys\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-serviceca\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc96ad5-da20-485b-87e1-bb21d8703401-konnectivity-ca\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/040f26c4-7552-482d-8f38-69ea79e0b858-hosts-file\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-netns\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.996993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-lib-modules\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cnibin\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pnqt\" (UniqueName: \"kubernetes.io/projected/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-kube-api-access-5pnqt\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-var-lib-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.001529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bfa8164-c387-4127-aedd-fee373b2281b-host-slash\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-modprobe-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-node-log\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-run\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-var-lib-kubelet\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-system-cni-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-kubelet-config\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-systemd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p49sg\" (UniqueName: \"kubernetes.io/projected/6bfa8164-c387-4127-aedd-fee373b2281b-kube-api-access-p49sg\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-multus\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-conf-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-host\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-netd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.005363 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-registration-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xw5\" (UniqueName: \"kubernetes.io/projected/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-kube-api-access-d9xw5\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040f26c4-7552-482d-8f38-69ea79e0b858-tmp-dir\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-run-netns\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-system-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cnibin\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-socket-dir-parent\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-cni-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-netns\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-systemd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-var-lib-cni-multus\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-multus-conf-dir\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bfa8164-c387-4127-aedd-fee373b2281b-host-slash\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-modprobe-d\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.006761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-run\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.997509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-run-openvswitch\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-script-lib\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-k8s-cni-cncf-io\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf49879-4dc7-4d01-b8ff-8ff657918c95-var-lib-kubelet\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1975b3d-03da-4558-aa15-1408d5b6c8a9-kubelet-config\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-host-run-k8s-cni-cncf-io\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.998535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08933b4-ce91-403c-92e9-49b0ba0319a5-host-cni-netd\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.998460    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.998758    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:57.498737478 +0000 UTC m=+3.030566445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:56.999049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-config\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.999147    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:57.008891 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:56.999198    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:57.499180554 +0000 UTC m=+3.031009540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.000021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-tmp\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.000959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-cni-binary-copy\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bfa8164-c387-4127-aedd-fee373b2281b-iptables-alerter-script\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/298966ad-fea8-49d8-8b61-55b075cb6704-os-release\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cf49879-4dc7-4d01-b8ff-8ff657918c95-etc-tuned\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.001876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.003453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovnkube-script-lib\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.003464    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.003483    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.003497    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.003575    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:57.503559663 +0000 UTC m=+3.035388631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:57.009896 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.003910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/298966ad-fea8-49d8-8b61-55b075cb6704-multus-daemon-config\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.051481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6nc2\" (UniqueName: \"kubernetes.io/projected/9cf49879-4dc7-4d01-b8ff-8ff657918c95-kube-api-access-g6nc2\") pod \"tuned-57lgf\" (UID: \"9cf49879-4dc7-4d01-b8ff-8ff657918c95\") " pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.051496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzlhm\" (UniqueName: \"kubernetes.io/projected/f08933b4-ce91-403c-92e9-49b0ba0319a5-kube-api-access-nzlhm\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.051494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zmh9\" (UniqueName: \"kubernetes.io/projected/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-kube-api-access-5zmh9\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.051734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal" event={"ID":"dbbb0615f3fefa38a3af027c8dc6b0b2","Type":"ContainerStarted","Data":"af174a81ebe69e6685aa2887d3adadd78483475880e7f5e663bbfa1b70bb5eaf"}
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.052531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08933b4-ce91-403c-92e9-49b0ba0319a5-ovn-node-metrics-cert\") pod \"ovnkube-node-npzts\" (UID: \"f08933b4-ce91-403c-92e9-49b0ba0319a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.057402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p49sg\" (UniqueName: \"kubernetes.io/projected/6bfa8164-c387-4127-aedd-fee373b2281b-kube-api-access-p49sg\") pod \"iptables-alerter-hk9h8\" (UID: \"6bfa8164-c387-4127-aedd-fee373b2281b\") " pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.059054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gsf\" (UniqueName: \"kubernetes.io/projected/298966ad-fea8-49d8-8b61-55b075cb6704-kube-api-access-b7gsf\") pod \"multus-g6njm\" (UID: \"298966ad-fea8-49d8-8b61-55b075cb6704\") " pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.060331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pnqt\" (UniqueName: \"kubernetes.io/projected/4760bda5-6aa1-443a-bfc6-ec01b1842b8b-kube-api-access-5pnqt\") pod \"multus-additional-cni-plugins-cc8n7\" (UID: \"4760bda5-6aa1-443a-bfc6-ec01b1842b8b\") " pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.083459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.060424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal" event={"ID":"38d3766cd9655156bf277457faa9cb8e","Type":"ContainerStarted","Data":"3bb79a03410dd538f61c7e60b1ce323f325a05e8b4db1ffb0be54f69a2b22a56"}
Jul 15 23:35:57.093382 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.084105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:35:57.094543 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.093472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cc8n7"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.098961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-socket-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.098993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5q7\" (UniqueName: \"kubernetes.io/projected/040f26c4-7552-482d-8f38-69ea79e0b858-kube-api-access-qh5q7\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-device-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-socket-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-etc-selinux\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7zj\" (UniqueName: \"kubernetes.io/projected/d345a3d2-5478-4345-9daa-42b4716eca38-kube-api-access-jl7zj\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-serviceca\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-etc-selinux\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc96ad5-da20-485b-87e1-bb21d8703401-konnectivity-ca\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/040f26c4-7552-482d-8f38-69ea79e0b858-hosts-file\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-host\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-registration-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.102343 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xw5\" (UniqueName: \"kubernetes.io/projected/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-kube-api-access-d9xw5\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040f26c4-7552-482d-8f38-69ea79e0b858-tmp-dir\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-sys-fs\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc96ad5-da20-485b-87e1-bb21d8703401-agent-certs\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.099864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dc96ad5-da20-485b-87e1-bb21d8703401-konnectivity-ca\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.100600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-serviceca\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.100979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.101222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-device-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.101467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/040f26c4-7552-482d-8f38-69ea79e0b858-hosts-file\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.101872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-host\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.101937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-registration-dir\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.101989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d345a3d2-5478-4345-9daa-42b4716eca38-sys-fs\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.103519 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.102378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08933b4_ce91_403c_92e9_49b0ba0319a5.slice/crio-f16c650458b9bd10bf7c71e48e902350d13a3715eddca549e14e384a29c6110a WatchSource:0}: Error finding container f16c650458b9bd10bf7c71e48e902350d13a3715eddca549e14e384a29c6110a: Status 404 returned error can't find the container with id f16c650458b9bd10bf7c71e48e902350d13a3715eddca549e14e384a29c6110a
Jul 15 23:35:57.106864 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.103597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040f26c4-7552-482d-8f38-69ea79e0b858-tmp-dir\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.114349 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.110286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xw5\" (UniqueName: \"kubernetes.io/projected/329c8b35-9a1e-45d8-8220-7a1f339f9d9b-kube-api-access-d9xw5\") pod \"node-ca-f9bzt\" (UID: \"329c8b35-9a1e-45d8-8220-7a1f339f9d9b\") " pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.114349 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.111297    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4760bda5_6aa1_443a_bfc6_ec01b1842b8b.slice/crio-a93c0a2aead69eb1c8c0940f7eb5219f04524f2f2b94052eed653629b90f83e0 WatchSource:0}: Error finding container a93c0a2aead69eb1c8c0940f7eb5219f04524f2f2b94052eed653629b90f83e0: Status 404 returned error can't find the container with id a93c0a2aead69eb1c8c0940f7eb5219f04524f2f2b94052eed653629b90f83e0
Jul 15 23:35:57.124260 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.115667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7zj\" (UniqueName: \"kubernetes.io/projected/d345a3d2-5478-4345-9daa-42b4716eca38-kube-api-access-jl7zj\") pod \"aws-ebs-csi-driver-node-22rkq\" (UID: \"d345a3d2-5478-4345-9daa-42b4716eca38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.124260 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.118599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6njm"
Jul 15 23:35:57.124260 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.119463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5q7\" (UniqueName: \"kubernetes.io/projected/040f26c4-7552-482d-8f38-69ea79e0b858-kube-api-access-qh5q7\") pod \"node-resolver-cbzgm\" (UID: \"040f26c4-7552-482d-8f38-69ea79e0b858\") " pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.129648 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.126433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57lgf"
Jul 15 23:35:57.129648 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.128717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dc96ad5-da20-485b-87e1-bb21d8703401-agent-certs\") pod \"konnectivity-agent-tzgm7\" (UID: \"6dc96ad5-da20-485b-87e1-bb21d8703401\") " pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.132661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298966ad_fea8_49d8_8b61_55b075cb6704.slice/crio-426c9cd21d1fc42fd671cc7a2e0ca79587c8528ad24a14c1d59eec57b9904aa9 WatchSource:0}: Error finding container 426c9cd21d1fc42fd671cc7a2e0ca79587c8528ad24a14c1d59eec57b9904aa9: Status 404 returned error can't find the container with id 426c9cd21d1fc42fd671cc7a2e0ca79587c8528ad24a14c1d59eec57b9904aa9
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.135795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq"
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.140670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf49879_4dc7_4d01_b8ff_8ff657918c95.slice/crio-87966ea0d3c578801b843882e325e242a8aa288d44b7a955ac6a57e1ceb4a298 WatchSource:0}: Error finding container 87966ea0d3c578801b843882e325e242a8aa288d44b7a955ac6a57e1ceb4a298: Status 404 returned error can't find the container with id 87966ea0d3c578801b843882e325e242a8aa288d44b7a955ac6a57e1ceb4a298
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.147409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbzgm"
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.151740    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd345a3d2_5478_4345_9daa_42b4716eca38.slice/crio-b2ce40005186292d4d60c72dc7d36e5dd448959a5c6c8a4ebbb47905c69290f0 WatchSource:0}: Error finding container b2ce40005186292d4d60c72dc7d36e5dd448959a5c6c8a4ebbb47905c69290f0: Status 404 returned error can't find the container with id b2ce40005186292d4d60c72dc7d36e5dd448959a5c6c8a4ebbb47905c69290f0
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.158110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.166823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9bzt"
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.175151    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc96ad5_da20_485b_87e1_bb21d8703401.slice/crio-f203b0f06250ac521c438e3cfbe03c77b54fcc52d2cbacc49bfd1644b2fdff6b WatchSource:0}: Error finding container f203b0f06250ac521c438e3cfbe03c77b54fcc52d2cbacc49bfd1644b2fdff6b: Status 404 returned error can't find the container with id f203b0f06250ac521c438e3cfbe03c77b54fcc52d2cbacc49bfd1644b2fdff6b
Jul 15 23:35:57.190669 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:35:57.179593    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329c8b35_9a1e_45d8_8220_7a1f339f9d9b.slice/crio-ade89fd8e5ee305a3fb3b3127df98ee93468b1440ba80a5fdfc37e64b1c6c3f1 WatchSource:0}: Error finding container ade89fd8e5ee305a3fb3b3127df98ee93468b1440ba80a5fdfc37e64b1c6c3f1: Status 404 returned error can't find the container with id ade89fd8e5ee305a3fb3b3127df98ee93468b1440ba80a5fdfc37e64b1c6c3f1
Jul 15 23:35:57.372927 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.353022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk9h8"
Jul 15 23:35:57.502820 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.502783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:57.502994 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.502848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:57.502994 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.502945    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:57.503086 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.503007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:58.502991879 +0000 UTC m=+4.034820851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:57.503086 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.502945    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:57.503086 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.503075    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:58.50306368 +0000 UTC m=+4.034892654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:57.603783 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.603699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:57.603935 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.603837    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:35:57.603935 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.603858    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:35:57.603935 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.603872    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:57.603935 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.603932    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:58.603913903 +0000 UTC m=+4.135742877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:57.930824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.930653    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:30:57 +0000 UTC" deadline="2028-01-14 05:10:35.556287118 +0000 UTC"
Jul 15 23:35:57.930824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.930719    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13133h34m37.625572571s"
Jul 15 23:35:57.990677 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:57.990071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:57.990677 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:57.990227    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:35:58.078532 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.078412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq" event={"ID":"d345a3d2-5478-4345-9daa-42b4716eca38","Type":"ContainerStarted","Data":"b2ce40005186292d4d60c72dc7d36e5dd448959a5c6c8a4ebbb47905c69290f0"}
Jul 15 23:35:58.086369 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.086307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"f16c650458b9bd10bf7c71e48e902350d13a3715eddca549e14e384a29c6110a"}
Jul 15 23:35:58.090887 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.090839    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzgm7" event={"ID":"6dc96ad5-da20-485b-87e1-bb21d8703401","Type":"ContainerStarted","Data":"f203b0f06250ac521c438e3cfbe03c77b54fcc52d2cbacc49bfd1644b2fdff6b"}
Jul 15 23:35:58.098378 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.098342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbzgm" event={"ID":"040f26c4-7552-482d-8f38-69ea79e0b858","Type":"ContainerStarted","Data":"b58bb94456d41c0091f044b1a60ce9f94d8d404e676eae57595ed4ca7ca55681"}
Jul 15 23:35:58.102282 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.102248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57lgf" event={"ID":"9cf49879-4dc7-4d01-b8ff-8ff657918c95","Type":"ContainerStarted","Data":"87966ea0d3c578801b843882e325e242a8aa288d44b7a955ac6a57e1ceb4a298"}
Jul 15 23:35:58.108256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.107831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6njm" event={"ID":"298966ad-fea8-49d8-8b61-55b075cb6704","Type":"ContainerStarted","Data":"426c9cd21d1fc42fd671cc7a2e0ca79587c8528ad24a14c1d59eec57b9904aa9"}
Jul 15 23:35:58.111966 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.111935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerStarted","Data":"a93c0a2aead69eb1c8c0940f7eb5219f04524f2f2b94052eed653629b90f83e0"}
Jul 15 23:35:58.114411 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.114383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9bzt" event={"ID":"329c8b35-9a1e-45d8-8220-7a1f339f9d9b","Type":"ContainerStarted","Data":"ade89fd8e5ee305a3fb3b3127df98ee93468b1440ba80a5fdfc37e64b1c6c3f1"}
Jul 15 23:35:58.511390 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.511334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:58.511902 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.511428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:58.511902 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.511596    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:58.511902 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.511661    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:00.511640568 +0000 UTC m=+6.043469542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:35:58.512106 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.512069    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:58.512160 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.512123    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:00.51210666 +0000 UTC m=+6.043935632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:35:58.615563 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.614839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:58.615563 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.615050    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:35:58.615563 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.615071    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:35:58.615563 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.615085    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:58.615563 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.615147    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:00.615127212 +0000 UTC m=+6.146956186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:35:58.931715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.931591    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:30:57 +0000 UTC" deadline="2028-04-29 00:16:06.219670442 +0000 UTC"
Jul 15 23:35:58.931715 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.931634    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15672h40m7.288041815s"
Jul 15 23:35:58.991681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.991154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:35:58.991681 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.991296    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:35:58.992247 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:58.992011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:35:58.992247 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:58.992132    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:35:59.991276 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:35:59.990914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:35:59.991276 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:35:59.991072    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:00.532911 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:00.532863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:00.533100 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:00.532969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:00.533171 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.533129    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:00.533221 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.533201    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:04.533179745 +0000 UTC m=+10.065008735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:00.533660 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.533637    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:00.533800 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.533697    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:04.533679959 +0000 UTC m=+10.065508926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:00.634355 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:00.634308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:00.634593 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.634556    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:36:00.634593 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.634585    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:36:00.634710 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.634600    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:00.634710 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.634666    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:04.634646054 +0000 UTC m=+10.166475043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:00.802558 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:00.802460    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfa8164_c387_4127_aedd_fee373b2281b.slice/crio-f49f58d495f8715f23186f4863d141e8573ea283144ac1db654f941a6438a573 WatchSource:0}: Error finding container f49f58d495f8715f23186f4863d141e8573ea283144ac1db654f941a6438a573: Status 404 returned error can't find the container with id f49f58d495f8715f23186f4863d141e8573ea283144ac1db654f941a6438a573
Jul 15 23:36:00.991701 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:00.991670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:00.992181 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.991805    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:00.994014 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:00.993819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:00.994014 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:00.993924    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:01.130067 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:01.129883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk9h8" event={"ID":"6bfa8164-c387-4127-aedd-fee373b2281b","Type":"ContainerStarted","Data":"f49f58d495f8715f23186f4863d141e8573ea283144ac1db654f941a6438a573"}
Jul 15 23:36:01.990745 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:01.990705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:01.990967 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:01.990872    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:02.992589 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:02.992547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:02.993020 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:02.992699    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:02.993020 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:02.992756    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:02.993020 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:02.992881    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:03.990968 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:03.990760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:03.990968 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:03.990917    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:04.569810 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:04.569772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:04.570325 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:04.569851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:04.570325 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.569926    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:04.570325 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.569975    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:04.570325 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.569995    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:12.569977736 +0000 UTC m=+18.101806708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:04.570325 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.570030    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:12.570012728 +0000 UTC m=+18.101841698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:04.670692 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:04.670540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:04.670888 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.670721    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:36:04.670888 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.670743    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:36:04.670888 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.670756    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:04.670888 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.670827    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:12.670804152 +0000 UTC m=+18.202633122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:04.992125 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:04.991362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:04.992125 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.991485    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:04.992125 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:04.991922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:04.992125 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:04.992022    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:05.990862 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:05.990826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:05.991356 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:05.990967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:06.990651 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:06.990132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:06.990651 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:06.990154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:06.990651 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:06.990275    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:06.990651 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:06.990401    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:07.990748 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:07.990720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:07.990925 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:07.990837    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:08.990229 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:08.990145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:08.990653 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:08.990275    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:08.990653 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:08.990320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:08.990653 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:08.990400    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:09.990347 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:09.990310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:09.990817 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:09.990434    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:10.991415 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:10.990866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:10.991415 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:10.991206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:10.991415 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:10.991242    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:10.991415 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:10.991359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:11.990358 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:11.990327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:11.990611 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:11.990465    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:12.629422 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:12.629297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:12.629422 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:12.629367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:12.629938 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.629542    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:12.629938 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.629568    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:12.629938 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.629640    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:28.629596407 +0000 UTC m=+34.161425375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:12.629938 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.629659    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:28.62964952 +0000 UTC m=+34.161478487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:12.730261 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:12.730230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:12.730441 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.730380    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:36:12.730441 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.730398    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:36:12.730441 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.730411    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:12.730603 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.730462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:36:28.730449789 +0000 UTC m=+34.262278755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:12.990776 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:12.990588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:12.990953 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.990785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:12.990953 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:12.990819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:12.990953 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:12.990933    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:13.990262 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:13.990225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:13.990732 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:13.990352    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:14.991126 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:14.991084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:14.991609 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:14.991190    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:14.991609 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:14.991276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:14.991609 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:14.991375    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:15.990582 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:15.990543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:15.990774 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:15.990696    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:16.990805 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:16.990775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:16.991205 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:16.990901    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:16.991205 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:16.990932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:16.991205 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:16.991035    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:17.160985 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.160742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal" event={"ID":"dbbb0615f3fefa38a3af027c8dc6b0b2","Type":"ContainerStarted","Data":"b2dd699e1a6b0d4337eb31a7eecdea19e068fc4c5eaddacaaa2112be41f1babc"}
Jul 15 23:36:17.162753 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.162715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"0208d6ff53b281888d9993ba333518bef1f1426f7d5e1b627e53d9e5cb7a13d6"}
Jul 15 23:36:17.162864 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.162778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"f307a9c380d70d0796ccee76f03259bab563986de93f2589ae4e42b4c56cf6ec"}
Jul 15 23:36:17.164310 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.164284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57lgf" event={"ID":"9cf49879-4dc7-4d01-b8ff-8ff657918c95","Type":"ContainerStarted","Data":"c67fd9486ab5a8437c69baf83934b80a82e4353733f25001f242bf050610ae21"}
Jul 15 23:36:17.165752 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.165730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6njm" event={"ID":"298966ad-fea8-49d8-8b61-55b075cb6704","Type":"ContainerStarted","Data":"348a0615f0048dc4dff3827e7447b82400d2613060bf1dea0b74bafb65a9c5a5"}
Jul 15 23:36:17.194455 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.194154    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-3.ec2.internal" podStartSLOduration=21.194132557 podStartE2EDuration="21.194132557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:17.178973491 +0000 UTC m=+22.710802479" watchObservedRunningTime="2026-07-15 23:36:17.194132557 +0000 UTC m=+22.725961551"
Jul 15 23:36:17.194851 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.194805    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-57lgf" podStartSLOduration=2.565227536 podStartE2EDuration="22.194792419s" totalImagesPullingTime="19.629564883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:17.193862342 +0000 UTC m=+22.725691327" watchObservedRunningTime="2026-07-15 23:36:17.194792419 +0000 UTC m=+22.726621408"
Jul 15 23:36:17.209713 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.209663    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g6njm" podStartSLOduration=2.520176858 podStartE2EDuration="22.20964738s" totalImagesPullingTime="19.689470522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:17.209422832 +0000 UTC m=+22.741251819" watchObservedRunningTime="2026-07-15 23:36:17.20964738 +0000 UTC m=+22.741476367"
Jul 15 23:36:17.991148 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:17.990938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:17.991924 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:17.991246    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:18.168879 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.168798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzgm7" event={"ID":"6dc96ad5-da20-485b-87e1-bb21d8703401","Type":"ContainerStarted","Data":"ca5454b4812b920c798080b7737a51382949b7515ada01fd022106b561091407"}
Jul 15 23:36:18.170227 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.170205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbzgm" event={"ID":"040f26c4-7552-482d-8f38-69ea79e0b858","Type":"ContainerStarted","Data":"d2982a2627895ef6f5f0a4c015e49fbf56e453604a8c191d5f6598b0c043657f"}
Jul 15 23:36:18.171632 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.171612    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="d86c9d3fb5497566040158e2e0e623411bf741458d21236b53c54b7be1863c51" exitCode=0
Jul 15 23:36:18.171735 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.171675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"d86c9d3fb5497566040158e2e0e623411bf741458d21236b53c54b7be1863c51"}
Jul 15 23:36:18.173080 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.173006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk9h8" event={"ID":"6bfa8164-c387-4127-aedd-fee373b2281b","Type":"ContainerStarted","Data":"50899326480ed9e32c07f81aeb468f14efed1171c503330e74ac7947599cb243"}
Jul 15 23:36:18.174529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.174507    2578 generic.go:356] "Generic (PLEG): container finished" podID="38d3766cd9655156bf277457faa9cb8e" containerID="256c963a64b78d8fca3faa380c7caf16075f6843e7d5b3f2f37eb2a7c7bdd044" exitCode=0
Jul 15 23:36:18.174629 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.174582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal" event={"ID":"38d3766cd9655156bf277457faa9cb8e","Type":"ContainerDied","Data":"256c963a64b78d8fca3faa380c7caf16075f6843e7d5b3f2f37eb2a7c7bdd044"}
Jul 15 23:36:18.176119 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.176056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9bzt" event={"ID":"329c8b35-9a1e-45d8-8220-7a1f339f9d9b","Type":"ContainerStarted","Data":"e290aca6600cf8af9ce9f28b3755be0b0e583c458cd349c69bd50fd30207aeae"}
Jul 15 23:36:18.177487 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.177470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq" event={"ID":"d345a3d2-5478-4345-9daa-42b4716eca38","Type":"ContainerStarted","Data":"cd13ccc64e5254979cf21f5d31b9ced44d6a13baf5384f6ad1265ff62f9d7772"}
Jul 15 23:36:18.180205 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.180183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"88de8933bcf97cfeee30028d0207497b82c6483ef60cc5e555b71df21badea70"}
Jul 15 23:36:18.180285 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.180254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"9bda6945388d64d4ee4aa6ef2a73edb90183547d9657090b4e0ea2473bf7664d"}
Jul 15 23:36:18.180323 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.180305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"7679a8b64682fd76f86a4908e33060e193f1f1fff511837d99681717f99743da"}
Jul 15 23:36:18.180365 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.180352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"05b212898ebe0c4ca634a84d4fb66efebf64510e824828819b4dbb7b02df4d2c"}
Jul 15 23:36:18.193272 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.193228    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tzgm7" podStartSLOduration=3.900949103 podStartE2EDuration="23.193215979s" totalImagesPullingTime="19.292266876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:18.192347076 +0000 UTC m=+23.724176065" watchObservedRunningTime="2026-07-15 23:36:18.193215979 +0000 UTC m=+23.725044967"
Jul 15 23:36:18.253320 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.253281    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hk9h8" podStartSLOduration=7.233360349 podStartE2EDuration="23.253266411s" totalImagesPullingTime="16.019906062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:18.253098116 +0000 UTC m=+23.784927098" watchObservedRunningTime="2026-07-15 23:36:18.253266411 +0000 UTC m=+23.785095399"
Jul 15 23:36:18.272732 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.272688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cbzgm" podStartSLOduration=3.971154966 podStartE2EDuration="23.27267323s" totalImagesPullingTime="19.301518264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:18.272408658 +0000 UTC m=+23.804237645" watchObservedRunningTime="2026-07-15 23:36:18.27267323 +0000 UTC m=+23.804502218"
Jul 15 23:36:18.296982 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.296937    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f9bzt" podStartSLOduration=4.008398719 podStartE2EDuration="23.29692323s" totalImagesPullingTime="19.288524511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:18.296622031 +0000 UTC m=+23.828451018" watchObservedRunningTime="2026-07-15 23:36:18.29692323 +0000 UTC m=+23.828752218"
Jul 15 23:36:18.536637 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.536608    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 23:36:18.971865 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.971737    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T23:36:18.536630958Z","UUID":"af6c75ba-bf8c-4089-9040-e6d15f3960f7","Handler":null,"Name":"","Endpoint":""}
Jul 15 23:36:18.973457 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.973432    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 23:36:18.973607 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.973473    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 23:36:18.990169 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.990139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:18.990295 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:18.990139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:18.990295 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:18.990283    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:18.990444 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:18.990343    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:19.185219 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:19.185171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal" event={"ID":"38d3766cd9655156bf277457faa9cb8e","Type":"ContainerStarted","Data":"8ebe6f7128102772d74981ea0cd349e0c7044ae5d1975d924520b484cea09e55"}
Jul 15 23:36:19.187416 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:19.187386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq" event={"ID":"d345a3d2-5478-4345-9daa-42b4716eca38","Type":"ContainerStarted","Data":"ef72b844ae518cca4d4305fd08359a9d07586cd1adde062dd597c812d08577e6"}
Jul 15 23:36:19.199702 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:19.198728    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-3.ec2.internal" podStartSLOduration=23.198708853 podStartE2EDuration="23.198708853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:19.198605268 +0000 UTC m=+24.730434257" watchObservedRunningTime="2026-07-15 23:36:19.198708853 +0000 UTC m=+24.730537825"
Jul 15 23:36:19.990631 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:19.990573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:19.990772 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:19.990731    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:20.194126 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.194091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"238629967c77bdf155f275df274db46bf8e563f7a9a4cf236f7bb808e4e0f614"}
Jul 15 23:36:20.196293 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.196252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq" event={"ID":"d345a3d2-5478-4345-9daa-42b4716eca38","Type":"ContainerStarted","Data":"150ad37f44157f146519a951c832e0d1b6e039f21161bdd6eb201d8ac1ef793a"}
Jul 15 23:36:20.212931 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.212885    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22rkq" podStartSLOduration=3.371323808 podStartE2EDuration="25.212869109s" totalImagesPullingTime="21.841545301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:20.212363887 +0000 UTC m=+25.744192876" watchObservedRunningTime="2026-07-15 23:36:20.212869109 +0000 UTC m=+25.744698093"
Jul 15 23:36:20.783907 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.783872    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:36:20.991035 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.990996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:20.991231 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:20.991129    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:20.991231 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:20.991194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:20.991355 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:20.991307    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:21.990296 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:21.990260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:21.990774 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:21.990395    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:22.360038 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:22.359959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:36:22.360576 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:22.360560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:36:22.990442 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:22.990201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:22.991367 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:22.990271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:22.991367 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:22.990464    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:22.991367 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:22.990556    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:23.207198 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.207167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" event={"ID":"f08933b4-ce91-403c-92e9-49b0ba0319a5","Type":"ContainerStarted","Data":"367dafadb437e657d5732bff705767479f3a839d7badd1b2c3bdbc75b36f6c37"}
Jul 15 23:36:23.207422 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.207406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:36:23.209025 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.209000    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="c9618177f4bfa30cfa07442209efe0797fa6058abb1a6cd6950d76b2482b9478" exitCode=0
Jul 15 23:36:23.209147 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.209080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"c9618177f4bfa30cfa07442209efe0797fa6058abb1a6cd6950d76b2482b9478"}
Jul 15 23:36:23.210227 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.209992    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tzgm7"
Jul 15 23:36:23.223202 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.223183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:36:23.231550 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.231513    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-npzts" podStartSLOduration=8.372062481 podStartE2EDuration="28.231480708s" totalImagesPullingTime="19.859418227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:23.230142181 +0000 UTC m=+28.761971168" watchObservedRunningTime="2026-07-15 23:36:23.231480708 +0000 UTC m=+28.763309689"
Jul 15 23:36:23.990584 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:23.990394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:23.991006 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:23.990655    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:24.222269 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.222109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:36:24.222269 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.222263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:36:24.239095 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.239074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:36:24.460327 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.460291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kj9l7"]
Jul 15 23:36:24.460568 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.460462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:24.460659 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:24.460631    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:24.461080 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.461062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssmhf"]
Jul 15 23:36:24.461159 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.461149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:24.461234 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:24.461217    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:24.467157 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.467137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhc56"]
Jul 15 23:36:24.467260 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:24.467220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:24.467317 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:24.467298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:25.225189 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:25.225155    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="1ee3274643893d653e30fbeb0aeda881a92fa14a8e2186d67c8d89827359518a" exitCode=0
Jul 15 23:36:25.225583 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:25.225238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"1ee3274643893d653e30fbeb0aeda881a92fa14a8e2186d67c8d89827359518a"}
Jul 15 23:36:25.991025 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:25.990992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:25.991210 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:25.991114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:25.991210 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:25.991130    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:25.991320 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:25.991226    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:25.991320 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:25.991132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:25.991399 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:25.991317    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:27.232580 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:27.232540    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="00efcbfa24a1a4246758a73b85826dbf06f25ceddcd9b053bcbb6869830c83c9" exitCode=0
Jul 15 23:36:27.233051 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:27.232624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"00efcbfa24a1a4246758a73b85826dbf06f25ceddcd9b053bcbb6869830c83c9"}
Jul 15 23:36:27.990830 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:27.990641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:27.991001 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:27.990724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:27.991001 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:27.990931    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:27.991001 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:27.990732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:27.991145 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:27.991014    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:27.991145 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:27.991107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:28.648278 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:28.648230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:28.648704 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:28.648314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:28.648704 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.648397    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:28.648704 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.648414    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:28.648704 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.648473    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret podName:b1975b3d-03da-4558-aa15-1408d5b6c8a9 nodeName:}" failed. No retries permitted until 2026-07-15 23:37:00.648452237 +0000 UTC m=+66.180281219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret") pod "global-pull-secret-syncer-kj9l7" (UID: "b1975b3d-03da-4558-aa15-1408d5b6c8a9") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:36:28.648704 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.648508    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs podName:64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8 nodeName:}" failed. No retries permitted until 2026-07-15 23:37:00.64848468 +0000 UTC m=+66.180313646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs") pod "network-metrics-daemon-qhc56" (UID: "64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:36:28.748866 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:28.748759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:28.749034 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.748900    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:36:28.749034 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.748923    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:36:28.749034 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.748933    2578 projected.go:196] Error preparing data for projected volume kube-api-access-ckzsb for pod openshift-network-diagnostics/network-check-target-ssmhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:28.749034 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:28.748988    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb podName:8da6b13a-5a46-446a-9e5c-a1a7e642a300 nodeName:}" failed. No retries permitted until 2026-07-15 23:37:00.748972885 +0000 UTC m=+66.280801850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckzsb" (UniqueName: "kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb") pod "network-check-target-ssmhf" (UID: "8da6b13a-5a46-446a-9e5c-a1a7e642a300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:36:29.990693 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:29.990646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:29.990693 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:29.990675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:29.990693 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:29.990678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:29.991263 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:29.990776    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssmhf" podUID="8da6b13a-5a46-446a-9e5c-a1a7e642a300"
Jul 15 23:36:29.991263 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:29.990862    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj9l7" podUID="b1975b3d-03da-4558-aa15-1408d5b6c8a9"
Jul 15 23:36:29.991263 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:29.990958    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhc56" podUID="64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8"
Jul 15 23:36:30.783639 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:30.783609    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-3.ec2.internal" event="NodeReady"
Jul 15 23:36:30.783831 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:30.783778    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 23:36:31.990300 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.990203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:36:31.990300 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.990265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:36:31.990886 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.990371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:36:31.993172 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993156    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:36:31.993220 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2fsj\""
Jul 15 23:36:31.993895 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qkb4z\""
Jul 15 23:36:31.993895 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993890    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:36:31.994006 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993904    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:36:31.994006 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:31.993893    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:36:32.246870 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:32.246790    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="9b2c8e37e3e6ed4382d0234d8bfe4a8ea506c26b3d4269443d8d12a986cc3ce5" exitCode=0
Jul 15 23:36:32.246870 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:32.246853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"9b2c8e37e3e6ed4382d0234d8bfe4a8ea506c26b3d4269443d8d12a986cc3ce5"}
Jul 15 23:36:33.252189 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:33.252149    2578 generic.go:356] "Generic (PLEG): container finished" podID="4760bda5-6aa1-443a-bfc6-ec01b1842b8b" containerID="c58adc2f6a99ad716715cd8d1cee3d7ce759fff8b73596045b30546da5f6447d" exitCode=0
Jul 15 23:36:33.252680 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:33.252224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerDied","Data":"c58adc2f6a99ad716715cd8d1cee3d7ce759fff8b73596045b30546da5f6447d"}
Jul 15 23:36:34.258030 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:34.257996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" event={"ID":"4760bda5-6aa1-443a-bfc6-ec01b1842b8b","Type":"ContainerStarted","Data":"2c9f9104923f0f5a9b79d094c3a81234490b8df684e4fabbf3caa94a8dffba31"}
Jul 15 23:36:34.280188 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:34.280077    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cc8n7" podStartSLOduration=8.861398091 podStartE2EDuration="39.280059932s" totalImagesPullingTime="30.418661841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:34.279669073 +0000 UTC m=+39.811498089" watchObservedRunningTime="2026-07-15 23:36:34.280059932 +0000 UTC m=+39.811888921"
Jul 15 23:36:52.091356 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.091320    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"]
Jul 15 23:36:52.093532 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.093516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.096780 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.096246    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6555b9469c-gl6sb"]
Jul 15 23:36:52.097458 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.097434    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 23:36:52.097833 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.097812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:36:52.098040 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.098018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 23:36:52.098116 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.098101    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nphpr\""
Jul 15 23:36:52.099263 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.099247    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6fb848bf5d-kvph8"]
Jul 15 23:36:52.099383 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.099368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.100819 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.100801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"]
Jul 15 23:36:52.100905 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.100890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.102841 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.102823    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 23:36:52.102928 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.102873    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 23:36:52.102974 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.102951    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 23:36:52.103098 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.103083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8982t\""
Jul 15 23:36:52.103138 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.103102    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-kgcx9"]
Jul 15 23:36:52.103227 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.103211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.104566 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104546    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6gqlh\""
Jul 15 23:36:52.104664 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104548    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 23:36:52.104664 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104637    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 23:36:52.104770 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"]
Jul 15 23:36:52.104839 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.104895 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 23:36:52.104895 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104855    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 23:36:52.104987 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.104826    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 23:36:52.105326 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.105308    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 23:36:52.106537 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.106398    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 23:36:52.106537 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.106404    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 23:36:52.106537 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.106454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 23:36:52.106537 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.106458    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 23:36:52.107469 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.107451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9095ac0f-d64a-479d-a177-72faaf0f121d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.107654 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.107633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpz9\" (UniqueName: \"kubernetes.io/projected/9095ac0f-d64a-479d-a177-72faaf0f121d-kube-api-access-4xpz9\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.108260 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.108241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:36:52.108632 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.108618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 23:36:52.109501 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.109470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 23:36:52.109733 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.109719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 23:36:52.110210 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.110187    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 23:36:52.110304 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.110210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4vhnh\""
Jul 15 23:36:52.115424 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.115400    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 23:36:52.116811 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.116707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kgcx9"]
Jul 15 23:36:52.121553 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.118449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"]
Jul 15 23:36:52.121553 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.119208    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6555b9469c-gl6sb"]
Jul 15 23:36:52.121553 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.120573    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fb848bf5d-kvph8"]
Jul 15 23:36:52.124485 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.124464    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"]
Jul 15 23:36:52.126463 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.126448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.129232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.129207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 23:36:52.129334 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.129254    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 23:36:52.129334 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.129311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 23:36:52.129419 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.129311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 23:36:52.143103 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.143083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"]
Jul 15 23:36:52.209214 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.209214 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d2a0f-2ab0-4957-b571-5e1a1913e125-serving-cert\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/268f567e-3cbc-42cc-b445-ca55101ca7f6-service-ca-bundle\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-stats-auth\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d54c\" (UniqueName: \"kubernetes.io/projected/268f567e-3cbc-42cc-b445-ca55101ca7f6-kube-api-access-2d54c\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.209428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/130d5eff-87bb-46d5-ac98-49b969922d29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrrdt\" (UniqueName: \"kubernetes.io/projected/777562b5-973d-4b16-b3ff-8489edc7727c-kube-api-access-jrrdt\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777562b5-973d-4b16-b3ff-8489edc7727c-tmp\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/777562b5-973d-4b16-b3ff-8489edc7727c-klusterlet-config\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9095ac0f-d64a-479d-a177-72faaf0f121d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-trusted-ca\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq52t\" (UniqueName: \"kubernetes.io/projected/db9d2a0f-2ab0-4957-b571-5e1a1913e125-kube-api-access-gq52t\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.209671 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-config\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdh6\" (UniqueName: \"kubernetes.io/projected/130d5eff-87bb-46d5-ac98-49b969922d29-kube-api-access-thdh6\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-default-certificate\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-metrics-certs\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccp8m\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpz9\" (UniqueName: \"kubernetes.io/projected/9095ac0f-d64a-479d-a177-72faaf0f121d-kube-api-access-4xpz9\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.210018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.209871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.213622 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.213599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9095ac0f-d64a-479d-a177-72faaf0f121d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.214687 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.214669    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bt76l"]
Jul 15 23:36:52.216571 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.216550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.219529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.219510    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 23:36:52.219637 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.219623    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 23:36:52.219704 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.219644    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 23:36:52.219704 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.219623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cl7fb\""
Jul 15 23:36:52.229888 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.229861    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bt76l"]
Jul 15 23:36:52.232362 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.232338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpz9\" (UniqueName: \"kubernetes.io/projected/9095ac0f-d64a-479d-a177-72faaf0f121d-kube-api-access-4xpz9\") pod \"cluster-samples-operator-65db858894-qgv8b\" (UID: \"9095ac0f-d64a-479d-a177-72faaf0f121d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.247301 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.247270    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6555b9469c-gl6sb"]
Jul 15 23:36:52.247529 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:36:52.247510    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-ccp8m registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6555b9469c-gl6sb" podUID="5c42adb7-e2e0-4a2f-b06f-220e5624fb24"
Jul 15 23:36:52.298659 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.298631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.300068 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.300048    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-688cb9ddc4-z8hjw"]
Jul 15 23:36:52.302140 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.302120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.302486 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.302467    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6ndlh"]
Jul 15 23:36:52.304407 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.304383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.305235 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.305215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.308675 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.308655    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 23:36:52.308898 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.308878    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 23:36:52.308985 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.308880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqf2z\""
Jul 15 23:36:52.310285 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.310367 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlc2k\" (UniqueName: \"kubernetes.io/projected/1b479cb4-01b8-4854-9b07-f1eafd6106c8-kube-api-access-zlc2k\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.310367 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccadbeac-a59c-4ef9-a075-dbb35fb22483-metrics-tls\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.310367 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-default-certificate\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.310536 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-metrics-certs\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.310592 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.310592 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccp8m\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.310694 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-bound-sa-token\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.310694 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.310795 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.310795 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.310795 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.310795 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-certificates\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-installation-pull-secrets\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d2a0f-2ab0-4957-b571-5e1a1913e125-serving-cert\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-image-registry-private-configuration\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/268f567e-3cbc-42cc-b445-ca55101ca7f6-service-ca-bundle\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b479cb4-01b8-4854-9b07-f1eafd6106c8-cert\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.310982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-stats-auth\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d54c\" (UniqueName: \"kubernetes.io/projected/268f567e-3cbc-42cc-b445-ca55101ca7f6-kube-api-access-2d54c\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86k25\" (UniqueName: \"kubernetes.io/projected/ccadbeac-a59c-4ef9-a075-dbb35fb22483-kube-api-access-86k25\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.311092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/130d5eff-87bb-46d5-ac98-49b969922d29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrrdt\" (UniqueName: \"kubernetes.io/projected/777562b5-973d-4b16-b3ff-8489edc7727c-kube-api-access-jrrdt\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-tls\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09b0479c-fdd4-4ada-9f17-4949b626d828-ca-trust-extracted\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777562b5-973d-4b16-b3ff-8489edc7727c-tmp\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/777562b5-973d-4b16-b3ff-8489edc7727c-klusterlet-config\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.311601 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-trusted-ca\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.311921 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.311921 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-trusted-ca\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.311921 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq52t\" (UniqueName: \"kubernetes.io/projected/db9d2a0f-2ab0-4957-b571-5e1a1913e125-kube-api-access-gq52t\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.312069 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccadbeac-a59c-4ef9-a075-dbb35fb22483-config-volume\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.312069 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.311962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.312069 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.312008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-config\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.312069 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.312034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccadbeac-a59c-4ef9-a075-dbb35fb22483-tmp-dir\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.312258 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.312095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdh6\" (UniqueName: \"kubernetes.io/projected/130d5eff-87bb-46d5-ac98-49b969922d29-kube-api-access-thdh6\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.312258 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.312127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.312258 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.312205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt42t\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-kube-api-access-zt42t\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.313250 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.313225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.313351 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.313317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/130d5eff-87bb-46d5-ac98-49b969922d29-additional-service-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.313710 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.313693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.314175 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.314150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-metrics-certs\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.314288 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.314238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-default-certificate\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.314534 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.314244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.314670 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.314649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777562b5-973d-4b16-b3ff-8489edc7727c-tmp\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.314960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.314940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/268f567e-3cbc-42cc-b445-ca55101ca7f6-service-ca-bundle\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.315571 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.315520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.315920 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.315875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-trusted-ca\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.316093 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.316065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db9d2a0f-2ab0-4957-b571-5e1a1913e125-config\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.316869 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.316842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d2a0f-2ab0-4957-b571-5e1a1913e125-serving-cert\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.316960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.316910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/268f567e-3cbc-42cc-b445-ca55101ca7f6-stats-auth\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.317439 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.317417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.317842 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.317799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.318233 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.318111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.318628 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.318607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-hub\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.318767 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.318748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/130d5eff-87bb-46d5-ac98-49b969922d29-ca\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.318933 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.318914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/777562b5-973d-4b16-b3ff-8489edc7727c-klusterlet-config\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.319030 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.319010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.323662 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.323460    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6ndlh"]
Jul 15 23:36:52.324476 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.324453    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-688cb9ddc4-z8hjw"]
Jul 15 23:36:52.335733 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.335707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccp8m\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.336248 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.336231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d54c\" (UniqueName: \"kubernetes.io/projected/268f567e-3cbc-42cc-b445-ca55101ca7f6-kube-api-access-2d54c\") pod \"router-default-6fb848bf5d-kvph8\" (UID: \"268f567e-3cbc-42cc-b445-ca55101ca7f6\") " pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.339897 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.339874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token\") pod \"image-registry-6555b9469c-gl6sb\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") " pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:52.340164 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.340148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdh6\" (UniqueName: \"kubernetes.io/projected/130d5eff-87bb-46d5-ac98-49b969922d29-kube-api-access-thdh6\") pod \"cluster-proxy-proxy-agent-556c59bcbb-xnwqq\" (UID: \"130d5eff-87bb-46d5-ac98-49b969922d29\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.344657 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.344599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq52t\" (UniqueName: \"kubernetes.io/projected/db9d2a0f-2ab0-4957-b571-5e1a1913e125-kube-api-access-gq52t\") pod \"console-operator-7866497494-kgcx9\" (UID: \"db9d2a0f-2ab0-4957-b571-5e1a1913e125\") " pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.345283 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.345261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrrdt\" (UniqueName: \"kubernetes.io/projected/777562b5-973d-4b16-b3ff-8489edc7727c-kube-api-access-jrrdt\") pod \"klusterlet-addon-workmgr-74674b5dbd-5bz75\" (UID: \"777562b5-973d-4b16-b3ff-8489edc7727c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.407186 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.407147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"
Jul 15 23:36:52.413231 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413209    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413314 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413244    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccp8m\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413314 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413278    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413440 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413485 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413466    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413560 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413560 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:36:52.413560 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413765 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration\") pod \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\" (UID: \"5c42adb7-e2e0-4a2f-b06f-220e5624fb24\") "
Jul 15 23:36:52.413765 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-image-registry-private-configuration\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.413765 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413717    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:36:52.413765 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b479cb4-01b8-4854-9b07-f1eafd6106c8-cert\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.413950 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86k25\" (UniqueName: \"kubernetes.io/projected/ccadbeac-a59c-4ef9-a075-dbb35fb22483-kube-api-access-86k25\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.413950 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-tls\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.413950 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09b0479c-fdd4-4ada-9f17-4949b626d828-ca-trust-extracted\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.413950 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413839    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:36:52.413950 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.413871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-trusted-ca\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.415079 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.415046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-trusted-ca\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.416330 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416295    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:36:52.416330 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416297    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:36:52.416512 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccadbeac-a59c-4ef9-a075-dbb35fb22483-config-volume\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.416512 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccadbeac-a59c-4ef9-a075-dbb35fb22483-tmp-dir\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.416512 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt42t\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-kube-api-access-zt42t\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.416512 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlc2k\" (UniqueName: \"kubernetes.io/projected/1b479cb4-01b8-4854-9b07-f1eafd6106c8-kube-api-access-zlc2k\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccadbeac-a59c-4ef9-a075-dbb35fb22483-metrics-tls\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-bound-sa-token\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-certificates\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-installation-pull-secrets\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b479cb4-01b8-4854-9b07-f1eafd6106c8-cert\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.416720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416709    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-trusted-ca\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.416993 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416730    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-certificates\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.416993 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416748    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-bound-sa-token\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.416993 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416763    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-image-registry-private-configuration\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.416993 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416777    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-ca-trust-extracted\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.416993 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.416913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccadbeac-a59c-4ef9-a075-dbb35fb22483-config-volume\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.417606 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-image-registry-private-configuration\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.417606 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09b0479c-fdd4-4ada-9f17-4949b626d828-ca-trust-extracted\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.417606 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccadbeac-a59c-4ef9-a075-dbb35fb22483-tmp-dir\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.417606 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:36:52.417981 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-tls\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.417981 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:36:52.417981 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m" (OuterVolumeSpecName: "kube-api-access-ccp8m") pod "5c42adb7-e2e0-4a2f-b06f-220e5624fb24" (UID: "5c42adb7-e2e0-4a2f-b06f-220e5624fb24"). InnerVolumeSpecName "kube-api-access-ccp8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:36:52.418090 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.417980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09b0479c-fdd4-4ada-9f17-4949b626d828-registry-certificates\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.419148 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.419128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09b0479c-fdd4-4ada-9f17-4949b626d828-installation-pull-secrets\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.419439 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.419419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccadbeac-a59c-4ef9-a075-dbb35fb22483-metrics-tls\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.426199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.426177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:52.429712 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.429682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86k25\" (UniqueName: \"kubernetes.io/projected/ccadbeac-a59c-4ef9-a075-dbb35fb22483-kube-api-access-86k25\") pod \"dns-default-6ndlh\" (UID: \"ccadbeac-a59c-4ef9-a075-dbb35fb22483\") " pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.429784 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.429689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-bound-sa-token\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.430275 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.430247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt42t\" (UniqueName: \"kubernetes.io/projected/09b0479c-fdd4-4ada-9f17-4949b626d828-kube-api-access-zt42t\") pod \"image-registry-688cb9ddc4-z8hjw\" (UID: \"09b0479c-fdd4-4ada-9f17-4949b626d828\") " pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.430348 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.430278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlc2k\" (UniqueName: \"kubernetes.io/projected/1b479cb4-01b8-4854-9b07-f1eafd6106c8-kube-api-access-zlc2k\") pod \"ingress-canary-bt76l\" (UID: \"1b479cb4-01b8-4854-9b07-f1eafd6106c8\") " pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.433101 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.433086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:36:52.438018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.437996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:36:52.452974 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.452935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"
Jul 15 23:36:52.518232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.518138    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-registry-tls\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.518232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.518168    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-installation-pull-secrets\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.518232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.518184    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccp8m\" (UniqueName: \"kubernetes.io/projected/5c42adb7-e2e0-4a2f-b06f-220e5624fb24-kube-api-access-ccp8m\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:36:52.528571 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.528298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bt76l"
Jul 15 23:36:52.614521 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.614385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b"]
Jul 15 23:36:52.615580 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.615363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:52.627235 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.627165    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kgcx9"]
Jul 15 23:36:52.643637 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.643603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"]
Jul 15 23:36:52.643930 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.643909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:36:52.650648 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.650615    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777562b5_973d_4b16_b3ff_8489edc7727c.slice/crio-f4956751e526447ef3d098bd19d9273a521e31ace260fe843a896ba7b63e57b4 WatchSource:0}: Error finding container f4956751e526447ef3d098bd19d9273a521e31ace260fe843a896ba7b63e57b4: Status 404 returned error can't find the container with id f4956751e526447ef3d098bd19d9273a521e31ace260fe843a896ba7b63e57b4
Jul 15 23:36:52.674560 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.674525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fb848bf5d-kvph8"]
Jul 15 23:36:52.681116 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.681084    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268f567e_3cbc_42cc_b445_ca55101ca7f6.slice/crio-6d9605c41535a8b4764234cbe841fabbda91c8f33642291a5e91231e20b019cc WatchSource:0}: Error finding container 6d9605c41535a8b4764234cbe841fabbda91c8f33642291a5e91231e20b019cc: Status 404 returned error can't find the container with id 6d9605c41535a8b4764234cbe841fabbda91c8f33642291a5e91231e20b019cc
Jul 15 23:36:52.739005 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.738981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bt76l"]
Jul 15 23:36:52.743678 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.743649    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b479cb4_01b8_4854_9b07_f1eafd6106c8.slice/crio-1db94713265f60a0fdc75302ae6a22519cd5d9d2bd9051aa21eef36b786b41f5 WatchSource:0}: Error finding container 1db94713265f60a0fdc75302ae6a22519cd5d9d2bd9051aa21eef36b786b41f5: Status 404 returned error can't find the container with id 1db94713265f60a0fdc75302ae6a22519cd5d9d2bd9051aa21eef36b786b41f5
Jul 15 23:36:52.791366 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.791156    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-688cb9ddc4-z8hjw"]
Jul 15 23:36:52.793904 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.793870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b0479c_fdd4_4ada_9f17_4949b626d828.slice/crio-8967c38e67eebfaeecb34436440e4ee4a7bea4d04711f19713de1a7a839525b5 WatchSource:0}: Error finding container 8967c38e67eebfaeecb34436440e4ee4a7bea4d04711f19713de1a7a839525b5: Status 404 returned error can't find the container with id 8967c38e67eebfaeecb34436440e4ee4a7bea4d04711f19713de1a7a839525b5
Jul 15 23:36:52.806811 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.806781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6ndlh"]
Jul 15 23:36:52.811298 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.811268    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccadbeac_a59c_4ef9_a075_dbb35fb22483.slice/crio-b4fd469bfdc1d0a44eb252705fdd328d0b2a36fbf81c1b7b958b9385f423c86f WatchSource:0}: Error finding container b4fd469bfdc1d0a44eb252705fdd328d0b2a36fbf81c1b7b958b9385f423c86f: Status 404 returned error can't find the container with id b4fd469bfdc1d0a44eb252705fdd328d0b2a36fbf81c1b7b958b9385f423c86f
Jul 15 23:36:52.870391 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:52.870320    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq"]
Jul 15 23:36:52.873030 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:36:52.873009    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod130d5eff_87bb_46d5_ac98_49b969922d29.slice/crio-44649c1f956409a8be21bb5b8ee9d5ef5010f5523549e79541098eddf072667b WatchSource:0}: Error finding container 44649c1f956409a8be21bb5b8ee9d5ef5010f5523549e79541098eddf072667b: Status 404 returned error can't find the container with id 44649c1f956409a8be21bb5b8ee9d5ef5010f5523549e79541098eddf072667b
Jul 15 23:36:53.303443 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.303359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ndlh" event={"ID":"ccadbeac-a59c-4ef9-a075-dbb35fb22483","Type":"ContainerStarted","Data":"b4fd469bfdc1d0a44eb252705fdd328d0b2a36fbf81c1b7b958b9385f423c86f"}
Jul 15 23:36:53.305154 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.305066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bt76l" event={"ID":"1b479cb4-01b8-4854-9b07-f1eafd6106c8","Type":"ContainerStarted","Data":"1db94713265f60a0fdc75302ae6a22519cd5d9d2bd9051aa21eef36b786b41f5"}
Jul 15 23:36:53.306660 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.306620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq" event={"ID":"130d5eff-87bb-46d5-ac98-49b969922d29","Type":"ContainerStarted","Data":"44649c1f956409a8be21bb5b8ee9d5ef5010f5523549e79541098eddf072667b"}
Jul 15 23:36:53.309008 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.308427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fb848bf5d-kvph8" event={"ID":"268f567e-3cbc-42cc-b445-ca55101ca7f6","Type":"ContainerStarted","Data":"5af5c4627278607a64ba7558b6238bfd7bb6fc89663d0c7d8ad727a8f287d863"}
Jul 15 23:36:53.309008 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.308467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fb848bf5d-kvph8" event={"ID":"268f567e-3cbc-42cc-b445-ca55101ca7f6","Type":"ContainerStarted","Data":"6d9605c41535a8b4764234cbe841fabbda91c8f33642291a5e91231e20b019cc"}
Jul 15 23:36:53.310872 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.310752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw" event={"ID":"09b0479c-fdd4-4ada-9f17-4949b626d828","Type":"ContainerStarted","Data":"0ae864a962f38ad06e87b9a51ff60159e5292081e3ccf38afadaff83a87bb010"}
Jul 15 23:36:53.310872 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.310796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw" event={"ID":"09b0479c-fdd4-4ada-9f17-4949b626d828","Type":"ContainerStarted","Data":"8967c38e67eebfaeecb34436440e4ee4a7bea4d04711f19713de1a7a839525b5"}
Jul 15 23:36:53.311339 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.311319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:36:53.312637 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.312616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b" event={"ID":"9095ac0f-d64a-479d-a177-72faaf0f121d","Type":"ContainerStarted","Data":"fc31cc881f8d39e34941adabb4dd1296770e50b492f71cdb3feb748733551049"}
Jul 15 23:36:53.314480 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.314415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75" event={"ID":"777562b5-973d-4b16-b3ff-8489edc7727c","Type":"ContainerStarted","Data":"f4956751e526447ef3d098bd19d9273a521e31ace260fe843a896ba7b63e57b4"}
Jul 15 23:36:53.318078 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.317544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kgcx9" event={"ID":"db9d2a0f-2ab0-4957-b571-5e1a1913e125","Type":"ContainerStarted","Data":"331e03f9f0f29a4d1a6eaff7ba9ded53256e23d52964c2a4b0912aa966b35141"}
Jul 15 23:36:53.318078 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.317543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6555b9469c-gl6sb"
Jul 15 23:36:53.327936 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.327591    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6fb848bf5d-kvph8" podStartSLOduration=1.327571875 podStartE2EDuration="1.327571875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:53.326335101 +0000 UTC m=+58.858164091" watchObservedRunningTime="2026-07-15 23:36:53.327571875 +0000 UTC m=+58.859400865"
Jul 15 23:36:53.359943 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.359908    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6555b9469c-gl6sb"]
Jul 15 23:36:53.363368 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.363341    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6555b9469c-gl6sb"]
Jul 15 23:36:53.426905 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.426873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:53.429936 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.429909    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:53.447267 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:53.447208    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw" podStartSLOduration=1.447185589 podStartE2EDuration="1.447185589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:36:53.383481685 +0000 UTC m=+58.915310674" watchObservedRunningTime="2026-07-15 23:36:53.447185589 +0000 UTC m=+58.979014581"
Jul 15 23:36:54.325679 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:54.324680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:54.326231 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:54.325795    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6fb848bf5d-kvph8"
Jul 15 23:36:54.999389 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:54.999182    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c42adb7-e2e0-4a2f-b06f-220e5624fb24" path="/var/lib/kubelet/pods/5c42adb7-e2e0-4a2f-b06f-220e5624fb24/volumes"
Jul 15 23:36:56.248035 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:36:56.247986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npzts"
Jul 15 23:37:00.672585 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.672552    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jdkhk"]
Jul 15 23:37:00.678423 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.678392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.681100 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.681074    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 23:37:00.681307 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.681277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-58kg9\""
Jul 15 23:37:00.682070 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.682052    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 23:37:00.683295 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.683265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 23:37:00.683394 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.683319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 23:37:00.695690 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.695661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdkhk"]
Jul 15 23:37:00.697828 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.697804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:37:00.697960 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.697857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:37:00.700548 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.700521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:37:00.700673 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.700521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:37:00.711292 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.711265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8-metrics-certs\") pod \"network-metrics-daemon-qhc56\" (UID: \"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8\") " pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:37:00.711435 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.711347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1975b3d-03da-4558-aa15-1408d5b6c8a9-original-pull-secret\") pod \"global-pull-secret-syncer-kj9l7\" (UID: \"b1975b3d-03da-4558-aa15-1408d5b6c8a9\") " pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:37:00.798274 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.798468 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-crio-socket\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.798468 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.798608 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:37:00.798608 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dv8\" (UniqueName: \"kubernetes.io/projected/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-api-access-h8dv8\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.798608 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.798575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-data-volume\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.800876 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.800855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:37:00.802140 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.802121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2fsj\""
Jul 15 23:37:00.805982 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.805962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj9l7"
Jul 15 23:37:00.810600 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.810581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhc56"
Jul 15 23:37:00.810700 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.810682    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:37:00.822722 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.822692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzsb\" (UniqueName: \"kubernetes.io/projected/8da6b13a-5a46-446a-9e5c-a1a7e642a300-kube-api-access-ckzsb\") pod \"network-check-target-ssmhf\" (UID: \"8da6b13a-5a46-446a-9e5c-a1a7e642a300\") " pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:37:00.899700 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.899813 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dv8\" (UniqueName: \"kubernetes.io/projected/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-api-access-h8dv8\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.899813 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-data-volume\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.899813 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.899942 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-crio-socket\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.899982 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.899959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-crio-socket\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.900926 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:00.900033    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 23:37:00.900926 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:00.900111    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:01.4000859 +0000 UTC m=+66.931914886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : configmap "kube-rbac-proxy" not found
Jul 15 23:37:00.900926 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:00.900747    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:00.900926 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:00.900815    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:01.400797862 +0000 UTC m=+66.932626840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:00.900926 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.900885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-data-volume\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:00.920367 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:00.918801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dv8\" (UniqueName: \"kubernetes.io/projected/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-api-access-h8dv8\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:01.067904 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.065125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kj9l7"]
Jul 15 23:37:01.079388 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:37:01.077906    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1975b3d_03da_4558_aa15_1408d5b6c8a9.slice/crio-f30d0f64c7fd97b87a578940cfbd3de1a1c329faf5f9e41c1628af20a2e0b773 WatchSource:0}: Error finding container f30d0f64c7fd97b87a578940cfbd3de1a1c329faf5f9e41c1628af20a2e0b773: Status 404 returned error can't find the container with id f30d0f64c7fd97b87a578940cfbd3de1a1c329faf5f9e41c1628af20a2e0b773
Jul 15 23:37:01.112921 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.110933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhc56"]
Jul 15 23:37:01.115432 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.113625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qkb4z\""
Jul 15 23:37:01.121958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.121815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:37:01.308275 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.308241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssmhf"]
Jul 15 23:37:01.312139 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:37:01.312108    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da6b13a_5a46_446a_9e5c_a1a7e642a300.slice/crio-76b873f8d16365e4e65afc053864d5e24da2c4a660d936231b86d9cfd3b5228c WatchSource:0}: Error finding container 76b873f8d16365e4e65afc053864d5e24da2c4a660d936231b86d9cfd3b5228c: Status 404 returned error can't find the container with id 76b873f8d16365e4e65afc053864d5e24da2c4a660d936231b86d9cfd3b5228c
Jul 15 23:37:01.347794 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.347758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ndlh" event={"ID":"ccadbeac-a59c-4ef9-a075-dbb35fb22483","Type":"ContainerStarted","Data":"9612b7b9cdb509fa55e65e407989f435349d02cbf22b1af2057f9c81af371903"}
Jul 15 23:37:01.347995 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.347822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ndlh" event={"ID":"ccadbeac-a59c-4ef9-a075-dbb35fb22483","Type":"ContainerStarted","Data":"d556855ed672a5cfe9884ed71920e6a214adad4612d5b99ed12e98c5a34e69f1"}
Jul 15 23:37:01.347995 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.347926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:37:01.349389 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.349373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bt76l" event={"ID":"1b479cb4-01b8-4854-9b07-f1eafd6106c8","Type":"ContainerStarted","Data":"702cc55b80dd591a337f8cd399ea1bc36007455f4f605193b85b384d0bd6dcfb"}
Jul 15 23:37:01.351506 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.351471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq" event={"ID":"130d5eff-87bb-46d5-ac98-49b969922d29","Type":"ContainerStarted","Data":"6a15693f4216f953b357072d28f63d4e4d1e4e4bd461a167575ec6e8f7002116"}
Jul 15 23:37:01.351590 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.351537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq" event={"ID":"130d5eff-87bb-46d5-ac98-49b969922d29","Type":"ContainerStarted","Data":"429e7e1450e3f86bce21ceb754a551df1f99e6908572956eada8642b47dbe202"}
Jul 15 23:37:01.351590 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.351553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq" event={"ID":"130d5eff-87bb-46d5-ac98-49b969922d29","Type":"ContainerStarted","Data":"0b1636d2b9c56cc7ce13098d88d43aee594deb224d41f0d63fd0664e80af6536"}
Jul 15 23:37:01.353165 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.353140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b" event={"ID":"9095ac0f-d64a-479d-a177-72faaf0f121d","Type":"ContainerStarted","Data":"eb172720ff62cfb9729a6c7f2f77a049321590be894c372f4c92eb2568f1bdc7"}
Jul 15 23:37:01.353270 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.353185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b" event={"ID":"9095ac0f-d64a-479d-a177-72faaf0f121d","Type":"ContainerStarted","Data":"9273c26c8fa9b36733ea7ad1c84eda5c9c013c179df5cdcfde678dd09c8152d1"}
Jul 15 23:37:01.354220 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.354203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssmhf" event={"ID":"8da6b13a-5a46-446a-9e5c-a1a7e642a300","Type":"ContainerStarted","Data":"76b873f8d16365e4e65afc053864d5e24da2c4a660d936231b86d9cfd3b5228c"}
Jul 15 23:37:01.355315 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.355293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhc56" event={"ID":"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8","Type":"ContainerStarted","Data":"7c4d3cdd5484a6c99cefd55dabff71114e5a4eb8cea5eb639c9567a78e68bd2c"}
Jul 15 23:37:01.356276 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.356253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kj9l7" event={"ID":"b1975b3d-03da-4558-aa15-1408d5b6c8a9","Type":"ContainerStarted","Data":"f30d0f64c7fd97b87a578940cfbd3de1a1c329faf5f9e41c1628af20a2e0b773"}
Jul 15 23:37:01.357640 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.357612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75" event={"ID":"777562b5-973d-4b16-b3ff-8489edc7727c","Type":"ContainerStarted","Data":"2712a088b15489e450fa4c0aed6c9826d77e5473f46dca400e39db11d8bed83e"}
Jul 15 23:37:01.357754 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.357737    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:37:01.359120 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.359091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kgcx9" event={"ID":"db9d2a0f-2ab0-4957-b571-5e1a1913e125","Type":"ContainerStarted","Data":"8b6c196b11afac7eb632b389b1a812d902efad0a0c77b3b9c6413c973906d59e"}
Jul 15 23:37:01.359308 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.359292    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:37:01.359608 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.359591    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75"
Jul 15 23:37:01.365776 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.365728    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6ndlh" podStartSLOduration=1.32152113 podStartE2EDuration="9.365713306s" totalImagesPullingTime="8.044192176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.364737222 +0000 UTC m=+66.896566211" watchObservedRunningTime="2026-07-15 23:37:01.365713306 +0000 UTC m=+66.897542291"
Jul 15 23:37:01.381244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.381192    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74674b5dbd-5bz75" podStartSLOduration=1.128164762 podStartE2EDuration="9.381177939s" totalImagesPullingTime="8.253013177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.379962163 +0000 UTC m=+66.911791152" watchObservedRunningTime="2026-07-15 23:37:01.381177939 +0000 UTC m=+66.913006928"
Jul 15 23:37:01.399069 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.399016    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-kgcx9" podStartSLOduration=1.164387068 podStartE2EDuration="9.399003213s" totalImagesPullingTime="8.234616145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.398609877 +0000 UTC m=+66.930438862" watchObservedRunningTime="2026-07-15 23:37:01.399003213 +0000 UTC m=+66.930832200"
Jul 15 23:37:01.409664 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.409626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:01.409838 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:01.409743    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 23:37:01.409838 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:01.409817    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:02.409795036 +0000 UTC m=+67.941624003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : configmap "kube-rbac-proxy" not found
Jul 15 23:37:01.409947 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.409866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:01.410157 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:01.410138    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:01.410263 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:01.410210    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:02.41019346 +0000 UTC m=+67.942022438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:01.414942 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.414893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-556c59bcbb-xnwqq" podStartSLOduration=1.407655572 podStartE2EDuration="9.414873643s" totalImagesPullingTime="8.007218071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.41444955 +0000 UTC m=+66.946278539" watchObservedRunningTime="2026-07-15 23:37:01.414873643 +0000 UTC m=+66.946702631"
Jul 15 23:37:01.429508 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.429396    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-qgv8b" podStartSLOduration=1.285651595 podStartE2EDuration="9.429380368s" totalImagesPullingTime="8.143728773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.428662702 +0000 UTC m=+66.960491688" watchObservedRunningTime="2026-07-15 23:37:01.429380368 +0000 UTC m=+66.961209387"
Jul 15 23:37:01.446650 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.446592    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bt76l" podStartSLOduration=1.308809574 podStartE2EDuration="9.446575476s" totalImagesPullingTime="8.137765902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:01.445469142 +0000 UTC m=+66.977298132" watchObservedRunningTime="2026-07-15 23:37:01.446575476 +0000 UTC m=+66.978404467"
Jul 15 23:37:01.462105 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.462073    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6ndlh_ccadbeac-a59c-4ef9-a075-dbb35fb22483/kube-rbac-proxy/0.log"
Jul 15 23:37:01.515542 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:01.515511    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-kgcx9"
Jul 15 23:37:02.260759 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.260731    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbzgm_040f26c4-7552-482d-8f38-69ea79e0b858/dns-node-resolver/0.log"
Jul 15 23:37:02.367964 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.367875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhc56" event={"ID":"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8","Type":"ContainerStarted","Data":"53b705e9e23988ce5b34d4fd02c59ea494eb78f24717a89973e85e2877969c1e"}
Jul 15 23:37:02.367964 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.367938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhc56" event={"ID":"64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8","Type":"ContainerStarted","Data":"800a94c1e3f664888d2a9d1ac5478ea8dedc01ff1030e9d0a9b2977ca8e63412"}
Jul 15 23:37:02.384446 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.384392    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qhc56" podStartSLOduration=66.418625616 podStartE2EDuration="1m7.384369575s" totalImagesPullingTime="965.743959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:02.383391328 +0000 UTC m=+67.915220310" watchObservedRunningTime="2026-07-15 23:37:02.384369575 +0000 UTC m=+67.916198564"
Jul 15 23:37:02.431398 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.431361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:02.431555 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.431537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:02.432007 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:02.431987    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:02.432097 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:02.432054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:04.432034269 +0000 UTC m=+69.963863237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:02.432508 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:02.432468    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 23:37:02.432614 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:02.432544    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:04.432527431 +0000 UTC m=+69.964356417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : configmap "kube-rbac-proxy" not found
Jul 15 23:37:02.661114 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:02.661026    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-688cb9ddc4-z8hjw_09b0479c-fdd4-4ada-9f17-4949b626d828/registry/0.log"
Jul 15 23:37:03.062509 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:03.062460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9bzt_329c8b35-9a1e-45d8-8220-7a1f339f9d9b/node-ca/0.log"
Jul 15 23:37:03.661210 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:03.661178    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fb848bf5d-kvph8_268f567e-3cbc-42cc-b445-ca55101ca7f6/router/0.log"
Jul 15 23:37:04.060136 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:04.060094    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bt76l_1b479cb4-01b8-4854-9b07-f1eafd6106c8/serve-healthcheck-canary/0.log"
Jul 15 23:37:04.450733 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:04.450639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:04.450909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:04.450732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:04.450909 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:04.450842    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 23:37:04.450909 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:04.450889    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:04.451068 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:04.450922    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:08.450904445 +0000 UTC m=+73.982733430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : configmap "kube-rbac-proxy" not found
Jul 15 23:37:04.451068 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:37:04.450957    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls podName:9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb nodeName:}" failed. No retries permitted until 2026-07-15 23:37:08.450942029 +0000 UTC m=+73.982770995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdkhk" (UID: "9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb") : secret "insights-runtime-extractor-tls" not found
Jul 15 23:37:06.387228 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:06.387194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssmhf" event={"ID":"8da6b13a-5a46-446a-9e5c-a1a7e642a300","Type":"ContainerStarted","Data":"0e95054598ac904dc5b3bedbb81bd031c3bece368f9a001a0a67201634f745b9"}
Jul 15 23:37:06.387708 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:06.387316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:37:06.388869 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:06.388848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kj9l7" event={"ID":"b1975b3d-03da-4558-aa15-1408d5b6c8a9","Type":"ContainerStarted","Data":"638cdf1fa18a6deda730b48cd7391a1dd2079e752254d268db3537f6247d879e"}
Jul 15 23:37:06.401477 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:06.401433    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ssmhf" podStartSLOduration=66.949646812 podStartE2EDuration="1m11.401419565s" totalImagesPullingTime="4.451772753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:06.400530174 +0000 UTC m=+71.932359162" watchObservedRunningTime="2026-07-15 23:37:06.401419565 +0000 UTC m=+71.933248552"
Jul 15 23:37:06.414430 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:06.414386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kj9l7" podStartSLOduration=66.728672649 podStartE2EDuration="1m11.414371469s" totalImagesPullingTime="4.68569882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:06.413552735 +0000 UTC m=+71.945381724" watchObservedRunningTime="2026-07-15 23:37:06.414371469 +0000 UTC m=+71.946200457"
Jul 15 23:37:08.484108 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.484066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:08.484479 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.484128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:08.484738 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.484711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:08.486418 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.486397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdkhk\" (UID: \"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb\") " pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:08.489426 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.489407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdkhk"
Jul 15 23:37:08.614002 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:08.613960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdkhk"]
Jul 15 23:37:08.616991 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:37:08.616960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9558ebb1_4d7f_4cd1_a775_96dde5bfc1fb.slice/crio-f7fc88808e0beec99458faeea21c66a12474f755f324c20b515f6dde73aa6883 WatchSource:0}: Error finding container f7fc88808e0beec99458faeea21c66a12474f755f324c20b515f6dde73aa6883: Status 404 returned error can't find the container with id f7fc88808e0beec99458faeea21c66a12474f755f324c20b515f6dde73aa6883
Jul 15 23:37:09.401703 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.401614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdkhk" event={"ID":"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb","Type":"ContainerStarted","Data":"f7fc88808e0beec99458faeea21c66a12474f755f324c20b515f6dde73aa6883"}
Jul 15 23:37:09.699527 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.699398    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hn5ss"]
Jul 15 23:37:09.701978 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.701955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.704437 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.704273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 23:37:09.704437 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.704321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 23:37:09.704437 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.704332    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8ccc6\""
Jul 15 23:37:09.704437 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.704425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 23:37:09.705542 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.705372    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 23:37:09.705542 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.705479    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 23:37:09.705756 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.705635    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 23:37:09.794817 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.794789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-root\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.794984 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.794822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-textfile\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.794984 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.794851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-wtmp\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.794984 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.794936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lxl\" (UniqueName: \"kubernetes.io/projected/cd39ec85-a7e1-4982-b41e-d49b94bdf088-kube-api-access-n2lxl\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.795108 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.794983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-sys\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.795108 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.795039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-accelerators-collector-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.795108 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.795077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.795239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.795109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-metrics-client-ca\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.795239 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.795133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-tls\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896155 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-root\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896155 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-textfile\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896387 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-wtmp\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896387 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lxl\" (UniqueName: \"kubernetes.io/projected/cd39ec85-a7e1-4982-b41e-d49b94bdf088-kube-api-access-n2lxl\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896387 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-root\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896387 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-sys\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-accelerators-collector-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-wtmp\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-metrics-client-ca\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd39ec85-a7e1-4982-b41e-d49b94bdf088-sys\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.896617 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.896529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-tls\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.897141 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.897099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-textfile\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.897141 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.897124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-metrics-client-ca\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.897311 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.897241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-accelerators-collector-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.901478 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.899362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.901478 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.899584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd39ec85-a7e1-4982-b41e-d49b94bdf088-node-exporter-tls\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:09.906534 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:09.906507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lxl\" (UniqueName: \"kubernetes.io/projected/cd39ec85-a7e1-4982-b41e-d49b94bdf088-kube-api-access-n2lxl\") pod \"node-exporter-hn5ss\" (UID: \"cd39ec85-a7e1-4982-b41e-d49b94bdf088\") " pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:10.013208 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:10.013178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hn5ss"
Jul 15 23:37:10.024073 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:37:10.024039    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd39ec85_a7e1_4982_b41e_d49b94bdf088.slice/crio-3a1958cf2753e4c632a961a54b65c78f3a2f69d2dd61d082fafa0153ab957df9 WatchSource:0}: Error finding container 3a1958cf2753e4c632a961a54b65c78f3a2f69d2dd61d082fafa0153ab957df9: Status 404 returned error can't find the container with id 3a1958cf2753e4c632a961a54b65c78f3a2f69d2dd61d082fafa0153ab957df9
Jul 15 23:37:10.406924 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:10.406842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hn5ss" event={"ID":"cd39ec85-a7e1-4982-b41e-d49b94bdf088","Type":"ContainerStarted","Data":"3a1958cf2753e4c632a961a54b65c78f3a2f69d2dd61d082fafa0153ab957df9"}
Jul 15 23:37:11.370552 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:11.370521    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6ndlh"
Jul 15 23:37:12.621086 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:12.621035    2578 patch_prober.go:28] interesting pod/image-registry-688cb9ddc4-z8hjw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 23:37:12.621538 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:12.621111    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw" podUID="09b0479c-fdd4-4ada-9f17-4949b626d828" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:37:14.426842 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:14.426805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdkhk" event={"ID":"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb","Type":"ContainerStarted","Data":"c07f41eea786964caac6750e49a79a7f071867fe67469c296f7bb305e10ad44c"}
Jul 15 23:37:14.429778 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:14.429731    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd39ec85-a7e1-4982-b41e-d49b94bdf088" containerID="fec7dbeeb1cb60dc7ccb2989f27fdab762aeac7e53cb0563c26752b9c1295ea8" exitCode=0
Jul 15 23:37:14.429914 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:14.429803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hn5ss" event={"ID":"cd39ec85-a7e1-4982-b41e-d49b94bdf088","Type":"ContainerDied","Data":"fec7dbeeb1cb60dc7ccb2989f27fdab762aeac7e53cb0563c26752b9c1295ea8"}
Jul 15 23:37:15.332819 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:15.332794    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-688cb9ddc4-z8hjw"
Jul 15 23:37:15.440985 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:15.440921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hn5ss" event={"ID":"cd39ec85-a7e1-4982-b41e-d49b94bdf088","Type":"ContainerStarted","Data":"99283e05f643c4db225ee818585a0546bf94a3a1456e3573f1f78865191360f7"}
Jul 15 23:37:15.441456 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:15.441062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hn5ss" event={"ID":"cd39ec85-a7e1-4982-b41e-d49b94bdf088","Type":"ContainerStarted","Data":"bb96f97d85c3db5f67524e5e8bb7193176fe530422ebf8d54a2116dd9bd0593f"}
Jul 15 23:37:15.460706 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:15.460647    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hn5ss" podStartSLOduration=2.743121683 podStartE2EDuration="6.460627089s" totalImagesPullingTime="3.649987604s" totalInitContainerRuntime="67.517802ms" isStatefulPod=true podCreationTimestamp="2026-07-15 23:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:15.459198537 +0000 UTC m=+80.991027591" watchObservedRunningTime="2026-07-15 23:37:15.460627089 +0000 UTC m=+80.992456158"
Jul 15 23:37:17.450267 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:17.450233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdkhk" event={"ID":"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb","Type":"ContainerStarted","Data":"593ccca2807d0b4a3d61bd5c1f7fc3e6bd31f7bdd9d175793ef04797f620e4b6"}
Jul 15 23:37:21.467212 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:21.467172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdkhk" event={"ID":"9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb","Type":"ContainerStarted","Data":"97dfc7ea7c3a1406bfa6729b14896faff58d61a2402c67be2bff6af43fdbf3c7"}
Jul 15 23:37:21.488077 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:21.488025    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jdkhk" podStartSLOduration=9.4076089 podStartE2EDuration="21.488009345s" totalImagesPullingTime="12.080400445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:37:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:21.482960805 +0000 UTC m=+87.014789796" watchObservedRunningTime="2026-07-15 23:37:21.488009345 +0000 UTC m=+87.019838334"
Jul 15 23:37:37.395046 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:37:37.395017    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ssmhf"
Jul 15 23:40:02.936524 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.936473    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"]
Jul 15 23:40:02.938733 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.938715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:02.945549 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.945532    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 23:40:02.946732 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.946718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 23:40:02.946982 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.946970    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 23:40:02.947974 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.947391    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6mmdc\""
Jul 15 23:40:02.952285 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.952265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 23:40:02.995210 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:02.995182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"]
Jul 15 23:40:03.089963 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.089933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-tmp\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.089963 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.089967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.090232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.090004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-manifests\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.090232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.090097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.090232 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.090142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gzxv\" (UniqueName: \"kubernetes.io/projected/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-kube-api-access-9gzxv\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191173 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191173 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gzxv\" (UniqueName: \"kubernetes.io/projected/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-kube-api-access-9gzxv\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191399 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-tmp\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191399 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191399 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-manifests\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.191794 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.191757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-manifests\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.193561 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.193541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-tmp\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.193766 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.193749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.193907 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.193888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.203146 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.203118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gzxv\" (UniqueName: \"kubernetes.io/projected/7ac4e2f5-35ce-4f58-bd6a-7be9f286b109-kube-api-access-9gzxv\") pod \"opendatahub-operator-controller-manager-5dcb68dc66-rjswv\" (UID: \"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109\") " pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.253155 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.253122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:03.379911 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:03.379859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"]
Jul 15 23:40:03.382647 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:03.382620    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac4e2f5_35ce_4f58_bd6a_7be9f286b109.slice/crio-658fe0aa529b40ece62e9ffcd1962bcdb7581c6709a51d286b2e5717d5e96848 WatchSource:0}: Error finding container 658fe0aa529b40ece62e9ffcd1962bcdb7581c6709a51d286b2e5717d5e96848: Status 404 returned error can't find the container with id 658fe0aa529b40ece62e9ffcd1962bcdb7581c6709a51d286b2e5717d5e96848
Jul 15 23:40:04.007694 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:04.007660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv" event={"ID":"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109","Type":"ContainerStarted","Data":"658fe0aa529b40ece62e9ffcd1962bcdb7581c6709a51d286b2e5717d5e96848"}
Jul 15 23:40:07.019290 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:07.019249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv" event={"ID":"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109","Type":"ContainerStarted","Data":"fdb69023093d5917ba3fbf18d7a88b2985dc68d3e92c1e561607a529231c59fc"}
Jul 15 23:40:08.029072 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:08.029030    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ac4e2f5-35ce-4f58-bd6a-7be9f286b109" containerID="fdb69023093d5917ba3fbf18d7a88b2985dc68d3e92c1e561607a529231c59fc" exitCode=0
Jul 15 23:40:08.029586 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:08.029068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv" event={"ID":"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109","Type":"ContainerDied","Data":"fdb69023093d5917ba3fbf18d7a88b2985dc68d3e92c1e561607a529231c59fc"}
Jul 15 23:40:09.034783 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:09.034747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv" event={"ID":"7ac4e2f5-35ce-4f58-bd6a-7be9f286b109","Type":"ContainerStarted","Data":"bbaa049c88e410c42690ba35a2ab7d7b381b0b815a10597038d10b601dca60f7"}
Jul 15 23:40:09.035258 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:09.034898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:09.055569 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:09.055516    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv" podStartSLOduration=2.595294712 podStartE2EDuration="7.055482171s" totalImagesPullingTime="3.366685111s" totalInitContainerRuntime="1.093502348s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:09.053363445 +0000 UTC m=+254.585192432" watchObservedRunningTime="2026-07-15 23:40:09.055482171 +0000 UTC m=+254.587311159"
Jul 15 23:40:20.039824 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:20.039736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dcb68dc66-rjswv"
Jul 15 23:40:22.883127 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.883084    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz4zw"]
Jul 15 23:40:22.889560 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.889529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:22.891920 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.891889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wcldn\""
Jul 15 23:40:22.892071 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.892033    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 23:40:22.896381 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.896354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz4zw"]
Jul 15 23:40:22.930477 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.930442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wt7k\" (UniqueName: \"kubernetes.io/projected/3c264be5-46bb-471d-b941-f2066f82bcab-kube-api-access-8wt7k\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:22.930477 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:22.930480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c264be5-46bb-471d-b941-f2066f82bcab-cert\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.031080 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.031042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c264be5-46bb-471d-b941-f2066f82bcab-cert\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.031222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.031109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wt7k\" (UniqueName: \"kubernetes.io/projected/3c264be5-46bb-471d-b941-f2066f82bcab-kube-api-access-8wt7k\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.033559 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.033533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c264be5-46bb-471d-b941-f2066f82bcab-cert\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.038662 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.038639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wt7k\" (UniqueName: \"kubernetes.io/projected/3c264be5-46bb-471d-b941-f2066f82bcab-kube-api-access-8wt7k\") pod \"odh-model-controller-7998c67dc4-gz4zw\" (UID: \"3c264be5-46bb-471d-b941-f2066f82bcab\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.202382 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.202300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:23.333052 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.333030    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz4zw"]
Jul 15 23:40:23.336089 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:23.336059    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c264be5_46bb_471d_b941_f2066f82bcab.slice/crio-a814eb4be1fbdb6d5c6b7a6e3470c5af7f76f73d70d695e2f2dc476ff6de7f47 WatchSource:0}: Error finding container a814eb4be1fbdb6d5c6b7a6e3470c5af7f76f73d70d695e2f2dc476ff6de7f47: Status 404 returned error can't find the container with id a814eb4be1fbdb6d5c6b7a6e3470c5af7f76f73d70d695e2f2dc476ff6de7f47
Jul 15 23:40:23.537391 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.537357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6jlz7"]
Jul 15 23:40:23.540054 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.540037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.543209 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.543188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 23:40:23.543332 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.543226    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-82tsz\""
Jul 15 23:40:23.555247 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.555216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6jlz7"]
Jul 15 23:40:23.633515 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.633460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppg8h\" (UniqueName: \"kubernetes.io/projected/a26e558f-7991-4fb9-8940-84572660349b-kube-api-access-ppg8h\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.633696 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.633549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26e558f-7991-4fb9-8940-84572660349b-tls-certs\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.734957 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.734918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26e558f-7991-4fb9-8940-84572660349b-tls-certs\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.735134 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.735009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppg8h\" (UniqueName: \"kubernetes.io/projected/a26e558f-7991-4fb9-8940-84572660349b-kube-api-access-ppg8h\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.737613 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.737585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26e558f-7991-4fb9-8940-84572660349b-tls-certs\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.763210 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.763179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppg8h\" (UniqueName: \"kubernetes.io/projected/a26e558f-7991-4fb9-8940-84572660349b-kube-api-access-ppg8h\") pod \"model-serving-api-54d89bd5fc-6jlz7\" (UID: \"a26e558f-7991-4fb9-8940-84572660349b\") " pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.850930 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.850826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:23.987774 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:23.987741    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6jlz7"]
Jul 15 23:40:23.992049 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:23.992018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26e558f_7991_4fb9_8940_84572660349b.slice/crio-18ff4840db2bf41bc17a2052cc2dbd1a8179394088f8c629802782a3184f3730 WatchSource:0}: Error finding container 18ff4840db2bf41bc17a2052cc2dbd1a8179394088f8c629802782a3184f3730: Status 404 returned error can't find the container with id 18ff4840db2bf41bc17a2052cc2dbd1a8179394088f8c629802782a3184f3730
Jul 15 23:40:24.088636 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:24.088593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7" event={"ID":"a26e558f-7991-4fb9-8940-84572660349b","Type":"ContainerStarted","Data":"18ff4840db2bf41bc17a2052cc2dbd1a8179394088f8c629802782a3184f3730"}
Jul 15 23:40:24.089937 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:24.089908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw" event={"ID":"3c264be5-46bb-471d-b941-f2066f82bcab","Type":"ContainerStarted","Data":"a814eb4be1fbdb6d5c6b7a6e3470c5af7f76f73d70d695e2f2dc476ff6de7f47"}
Jul 15 23:40:27.103157 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.103117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7" event={"ID":"a26e558f-7991-4fb9-8940-84572660349b","Type":"ContainerStarted","Data":"08c411f1ec25706685102990c3c93a223a4fa194721d95cb083e247c446b6cb4"}
Jul 15 23:40:27.103633 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.103231    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:27.104576 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.104555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw" event={"ID":"3c264be5-46bb-471d-b941-f2066f82bcab","Type":"ContainerStarted","Data":"4899ab3f104cbdd8e2348d7bc1463b0c108a4233f251e1962df6e7c603672076"}
Jul 15 23:40:27.104685 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.104674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:27.120156 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.120110    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7" podStartSLOduration=1.549610821 podStartE2EDuration="4.120080068s" totalImagesPullingTime="2.570469247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:27.118911568 +0000 UTC m=+272.650740559" watchObservedRunningTime="2026-07-15 23:40:27.120080068 +0000 UTC m=+272.651909058"
Jul 15 23:40:27.135843 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:27.135792    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw" podStartSLOduration=1.905165084 podStartE2EDuration="5.135777431s" totalImagesPullingTime="3.230612347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:27.13464461 +0000 UTC m=+272.666473597" watchObservedRunningTime="2026-07-15 23:40:27.135777431 +0000 UTC m=+272.667606418"
Jul 15 23:40:28.090510 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.090470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"]
Jul 15 23:40:28.093849 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.093820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.097262 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.097234    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w9kgv\""
Jul 15 23:40:28.097401 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.097307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 23:40:28.098082 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.098065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 23:40:28.107277 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.107250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"]
Jul 15 23:40:28.173873 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.173844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tls-certs\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.174055 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.173914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5zx\" (UniqueName: \"kubernetes.io/projected/31a79a5c-6d28-4f27-b569-e29489f1a4ff-kube-api-access-8z5zx\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.174055 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.174010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tmp\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.275018 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.274980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tls-certs\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.275201 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.275039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5zx\" (UniqueName: \"kubernetes.io/projected/31a79a5c-6d28-4f27-b569-e29489f1a4ff-kube-api-access-8z5zx\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.275201 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.275064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tmp\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.277395 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.277365    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tmp\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.277634 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.277610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a79a5c-6d28-4f27-b569-e29489f1a4ff-tls-certs\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.283787 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.283767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5zx\" (UniqueName: \"kubernetes.io/projected/31a79a5c-6d28-4f27-b569-e29489f1a4ff-kube-api-access-8z5zx\") pod \"kube-auth-proxy-7d6684b565-pwss8\" (UID: \"31a79a5c-6d28-4f27-b569-e29489f1a4ff\") " pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.403949 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.403837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"
Jul 15 23:40:28.540044 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:28.540019    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6684b565-pwss8"]
Jul 15 23:40:28.542751 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:28.542720    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a79a5c_6d28_4f27_b569_e29489f1a4ff.slice/crio-e1e968d012020b802d9cc2cbe2f228053fef858aa864d2aab61ea38b48965b02 WatchSource:0}: Error finding container e1e968d012020b802d9cc2cbe2f228053fef858aa864d2aab61ea38b48965b02: Status 404 returned error can't find the container with id e1e968d012020b802d9cc2cbe2f228053fef858aa864d2aab61ea38b48965b02
Jul 15 23:40:29.113455 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.113419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8" event={"ID":"31a79a5c-6d28-4f27-b569-e29489f1a4ff","Type":"ContainerStarted","Data":"e1e968d012020b802d9cc2cbe2f228053fef858aa864d2aab61ea38b48965b02"}
Jul 15 23:40:29.346828 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.346794    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:29.350101 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.350078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.353088 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.352939    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 23:40:29.353088 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.352960    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 23:40:29.353088 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.353002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 23:40:29.353409 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.353389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5zh7t\""
Jul 15 23:40:29.353554 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.353459    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 23:40:29.369252 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.369166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:29.383450 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383614 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383614 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383614 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383614 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383776 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.383776 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.383671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.484951 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.484895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.484951 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.484933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485234 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.484991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485234 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.485012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485234 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.485046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485411 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.485232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485411 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.485417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.485734 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.485711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.487541 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.487520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.487879 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.487863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.487954 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.487900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.488079 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.488054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.512933 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.512907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.522790 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.522762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kn4p\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.661653 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.661574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:29.812718 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:29.812675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:30.118826 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:30.118786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" event={"ID":"bb091a62-a066-4870-9e69-c0ce8b993dbf","Type":"ContainerStarted","Data":"2baab645b3ea0e3e62872f59d7a71dfbefcceaf1271240370370c37016e39c40"}
Jul 15 23:40:31.125001 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:31.124967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8" event={"ID":"31a79a5c-6d28-4f27-b569-e29489f1a4ff","Type":"ContainerStarted","Data":"39e4117e8899d383185d6c6f54334888de62fd3f6d0bfc3598ab52d6819ce74b"}
Jul 15 23:40:31.170353 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:31.170280    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6684b565-pwss8" podStartSLOduration=0.738011949 podStartE2EDuration="3.170256622s" totalImagesPullingTime="2.432244673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:31.169814887 +0000 UTC m=+276.701643904" watchObservedRunningTime="2026-07-15 23:40:31.170256622 +0000 UTC m=+276.702085611"
Jul 15 23:40:32.754753 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:32.754694    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:40:32.755123 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:32.754829    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:40:33.135005 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:33.134972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" event={"ID":"bb091a62-a066-4870-9e69-c0ce8b993dbf","Type":"ContainerStarted","Data":"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"}
Jul 15 23:40:33.135201 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:33.135128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:33.136820 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:33.136794    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7kn4p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 23:40:33.136956 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:33.136848    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:40:33.194410 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:33.194352    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" podStartSLOduration=1.26012604 podStartE2EDuration="4.194333098s" totalImagesPullingTime="2.934207058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:33.18641922 +0000 UTC m=+278.718248207" watchObservedRunningTime="2026-07-15 23:40:33.194333098 +0000 UTC m=+278.726162083"
Jul 15 23:40:34.013310 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.012506    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"]
Jul 15 23:40:34.016511 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.016475    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"]
Jul 15 23:40:34.016634 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.016606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.019816 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.019795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.020710 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.020688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bzg5r\""
Jul 15 23:40:34.020873 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.020774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 23:40:34.022147 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.022126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7jzv6\""
Jul 15 23:40:34.027030 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.027014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 23:40:34.039867 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.039846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"]
Jul 15 23:40:34.065580 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.063045    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"]
Jul 15 23:40:34.126831 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.126797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd89bd5-6432-4415-af25-20d76992a873-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.126992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.126849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5cbf\" (UniqueName: \"kubernetes.io/projected/261a8450-c7ac-4bda-b72f-0272246b7269-kube-api-access-n5cbf\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.126992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.126881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d66mc\" (UniqueName: \"kubernetes.io/projected/cbd89bd5-6432-4415-af25-20d76992a873-kube-api-access-d66mc\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.126992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.126952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261a8450-c7ac-4bda-b72f-0272246b7269-cert\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.139534 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.139482    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7kn4p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 23:40:34.139674 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.139573    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:40:34.227876 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.227843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d66mc\" (UniqueName: \"kubernetes.io/projected/cbd89bd5-6432-4415-af25-20d76992a873-kube-api-access-d66mc\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.228048 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.227905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261a8450-c7ac-4bda-b72f-0272246b7269-cert\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.228048 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.227993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd89bd5-6432-4415-af25-20d76992a873-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.228163 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.228116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5cbf\" (UniqueName: \"kubernetes.io/projected/261a8450-c7ac-4bda-b72f-0272246b7269-kube-api-access-n5cbf\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.230376 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.230352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd89bd5-6432-4415-af25-20d76992a873-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.230376 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.230367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261a8450-c7ac-4bda-b72f-0272246b7269-cert\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.264866 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.264790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5cbf\" (UniqueName: \"kubernetes.io/projected/261a8450-c7ac-4bda-b72f-0272246b7269-kube-api-access-n5cbf\") pod \"kserve-controller-manager-d6f4b65b8-tpgww\" (UID: \"261a8450-c7ac-4bda-b72f-0272246b7269\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.265751 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.265721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d66mc\" (UniqueName: \"kubernetes.io/projected/cbd89bd5-6432-4415-af25-20d76992a873-kube-api-access-d66mc\") pod \"llmisvc-controller-manager-777c6bd7d5-lg2pp\" (UID: \"cbd89bd5-6432-4415-af25-20d76992a873\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.329174 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.329138    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:34.334423 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.334403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:34.515852 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.515829    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"]
Jul 15 23:40:34.518296 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:34.518269    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261a8450_c7ac_4bda_b72f_0272246b7269.slice/crio-0ab6409ab8ca15ffca8100cbd78aad8ea4b77ffaad39022e381387906f556c27 WatchSource:0}: Error finding container 0ab6409ab8ca15ffca8100cbd78aad8ea4b77ffaad39022e381387906f556c27: Status 404 returned error can't find the container with id 0ab6409ab8ca15ffca8100cbd78aad8ea4b77ffaad39022e381387906f556c27
Jul 15 23:40:34.563259 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:34.563226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"]
Jul 15 23:40:34.565369 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:40:34.565340    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbd89bd5_6432_4415_af25_20d76992a873.slice/crio-461d2e68fba63fea3a7f0eec22437e8c13c0f8a1bbbc20be9c6d925e02ce4d22 WatchSource:0}: Error finding container 461d2e68fba63fea3a7f0eec22437e8c13c0f8a1bbbc20be9c6d925e02ce4d22: Status 404 returned error can't find the container with id 461d2e68fba63fea3a7f0eec22437e8c13c0f8a1bbbc20be9c6d925e02ce4d22
Jul 15 23:40:35.143385 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:35.143350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp" event={"ID":"cbd89bd5-6432-4415-af25-20d76992a873","Type":"ContainerStarted","Data":"461d2e68fba63fea3a7f0eec22437e8c13c0f8a1bbbc20be9c6d925e02ce4d22"}
Jul 15 23:40:35.144369 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:35.144346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww" event={"ID":"261a8450-c7ac-4bda-b72f-0272246b7269","Type":"ContainerStarted","Data":"0ab6409ab8ca15ffca8100cbd78aad8ea4b77ffaad39022e381387906f556c27"}
Jul 15 23:40:37.140003 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:37.139972    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:37.154487 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:37.154448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww" event={"ID":"261a8450-c7ac-4bda-b72f-0272246b7269","Type":"ContainerStarted","Data":"d378cf84ff03f2c490ef5912913d54c62d539c8951dfb310c467af21fc7ff2e5"}
Jul 15 23:40:37.154679 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:37.154532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:40:37.215473 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:37.215417    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww" podStartSLOduration=2.033963016 podStartE2EDuration="4.215393697s" totalImagesPullingTime="2.181430681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:37.21504049 +0000 UTC m=+282.746869479" watchObservedRunningTime="2026-07-15 23:40:37.215393697 +0000 UTC m=+282.747222764"
Jul 15 23:40:38.110991 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.110960    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gz4zw"
Jul 15 23:40:38.112934 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.112918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6jlz7"
Jul 15 23:40:38.161032 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.160990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp" event={"ID":"cbd89bd5-6432-4415-af25-20d76992a873","Type":"ContainerStarted","Data":"11927ed367b975274bb87e2aef804d62ae82d310114c2468cffa64070a646b8c"}
Jul 15 23:40:38.161478 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.161173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:40:38.186413 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.186349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp" podStartSLOduration=2.228029923 podStartE2EDuration="5.186325721s" totalImagesPullingTime="2.958295798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:38.186174448 +0000 UTC m=+283.718003437" watchObservedRunningTime="2026-07-15 23:40:38.186325721 +0000 UTC m=+283.718154710"
Jul 15 23:40:38.372985 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.372912    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:38.373122 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.373087    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery" containerID="cri-o://0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7" gracePeriod=30
Jul 15 23:40:38.620102 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.620081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:38.668235 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668153    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668235 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668235 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668274    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.668529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.668377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token\") pod \"bb091a62-a066-4870-9e69-c0ce8b993dbf\" (UID: \"bb091a62-a066-4870-9e69-c0ce8b993dbf\") "
Jul 15 23:40:38.669209 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.669166    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:40:38.671130 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:40:38.671244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:40:38.671244 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn" (OuterVolumeSpecName: "kube-api-access-7wrdn") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "kube-api-access-7wrdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:40:38.671533 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671472    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts" (OuterVolumeSpecName: "cacerts") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:40:38.671643 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:40:38.671858 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.671833    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs" (OuterVolumeSpecName: "local-certs") pod "bb091a62-a066-4870-9e69-c0ce8b993dbf" (UID: "bb091a62-a066-4870-9e69-c0ce8b993dbf"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:40:38.769587 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769550    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-kube-api-access-7wrdn\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769587 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769582    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-cacerts\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769587 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769593    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-kubeconfig\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769814 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769602    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-dns-cert\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769814 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769610    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-csr-ca-configmap\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769814 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769619    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb091a62-a066-4870-9e69-c0ce8b993dbf-local-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:38.769814 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:38.769626    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb091a62-a066-4870-9e69-c0ce8b993dbf-istio-token\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:40:39.166201 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.166165    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerID="0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7" exitCode=0
Jul 15 23:40:39.166201 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.166205    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"
Jul 15 23:40:39.166678 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.166247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" event={"ID":"bb091a62-a066-4870-9e69-c0ce8b993dbf","Type":"ContainerDied","Data":"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"}
Jul 15 23:40:39.166678 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.166304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p" event={"ID":"bb091a62-a066-4870-9e69-c0ce8b993dbf","Type":"ContainerDied","Data":"2baab645b3ea0e3e62872f59d7a71dfbefcceaf1271240370370c37016e39c40"}
Jul 15 23:40:39.166678 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.166326    2578 scope.go:117] "RemoveContainer" containerID="0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"
Jul 15 23:40:39.174693 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.174677    2578 scope.go:117] "RemoveContainer" containerID="0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"
Jul 15 23:40:39.174954 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:40:39.174937    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7\": container with ID starting with 0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7 not found: ID does not exist" containerID="0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"
Jul 15 23:40:39.175000 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.174962    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7"} err="failed to get container status \"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7\": rpc error: code = NotFound desc = could not find container \"0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7\": container with ID starting with 0b86a7e7c3132185b574bf068b57c22b4de9058dc106224ea23a458372c35df7 not found: ID does not exist"
Jul 15 23:40:39.182853 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.182826    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:39.189651 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:39.189627    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kn4p"]
Jul 15 23:40:40.995548 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:40.995515    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" path="/var/lib/kubelet/pods/bb091a62-a066-4870-9e69-c0ce8b993dbf/volumes"
Jul 15 23:40:54.905372 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:40:54.905350    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 23:41:08.166944 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:08.166913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tpgww"
Jul 15 23:41:09.169160 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:09.169134    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lg2pp"
Jul 15 23:41:23.662849 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.662813    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:23.663203 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.663129    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery"
Jul 15 23:41:23.663203 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.663139    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery"
Jul 15 23:41:23.663203 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.663188    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb091a62-a066-4870-9e69-c0ce8b993dbf" containerName="discovery"
Jul 15 23:41:23.664991 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.664973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:23.667451 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.667433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l2gxj\""
Jul 15 23:41:23.667569 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.667435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 23:41:23.669014 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.668980    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 23:41:23.675730 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.675709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:23.740767 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.740732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrlr\" (UniqueName: \"kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr\") pod \"kuadrant-operator-catalog-r885t\" (UID: \"c210fa57-cf61-4b97-99ae-e2c0b026cc96\") " pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:23.842089 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.842052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrlr\" (UniqueName: \"kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr\") pod \"kuadrant-operator-catalog-r885t\" (UID: \"c210fa57-cf61-4b97-99ae-e2c0b026cc96\") " pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:23.850249 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.850216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrlr\" (UniqueName: \"kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr\") pod \"kuadrant-operator-catalog-r885t\" (UID: \"c210fa57-cf61-4b97-99ae-e2c0b026cc96\") " pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:23.975902 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:23.975810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:24.021888 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.021856    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:24.101290 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.101258    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:24.104481 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:41:24.104450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc210fa57_cf61_4b97_99ae_e2c0b026cc96.slice/crio-70a91f2dc2f4bdac0ef43735e08e768a26fca958413d575a4a324fdc772c7ee8 WatchSource:0}: Error finding container 70a91f2dc2f4bdac0ef43735e08e768a26fca958413d575a4a324fdc772c7ee8: Status 404 returned error can't find the container with id 70a91f2dc2f4bdac0ef43735e08e768a26fca958413d575a4a324fdc772c7ee8
Jul 15 23:41:24.106104 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.106082    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:41:24.232563 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.232456    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vdtp"]
Jul 15 23:41:24.235433 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.235408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:24.243195 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.243160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vdtp"]
Jul 15 23:41:24.244475 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.244451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bgh\" (UniqueName: \"kubernetes.io/projected/5fcb4a75-263f-4662-a4a5-7a56ee3fcac8-kube-api-access-h9bgh\") pod \"kuadrant-operator-catalog-9vdtp\" (UID: \"5fcb4a75-263f-4662-a4a5-7a56ee3fcac8\") " pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:24.343637 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.343601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r885t" event={"ID":"c210fa57-cf61-4b97-99ae-e2c0b026cc96","Type":"ContainerStarted","Data":"70a91f2dc2f4bdac0ef43735e08e768a26fca958413d575a4a324fdc772c7ee8"}
Jul 15 23:41:24.344955 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.344937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bgh\" (UniqueName: \"kubernetes.io/projected/5fcb4a75-263f-4662-a4a5-7a56ee3fcac8-kube-api-access-h9bgh\") pod \"kuadrant-operator-catalog-9vdtp\" (UID: \"5fcb4a75-263f-4662-a4a5-7a56ee3fcac8\") " pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:24.352699 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.352676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bgh\" (UniqueName: \"kubernetes.io/projected/5fcb4a75-263f-4662-a4a5-7a56ee3fcac8-kube-api-access-h9bgh\") pod \"kuadrant-operator-catalog-9vdtp\" (UID: \"5fcb4a75-263f-4662-a4a5-7a56ee3fcac8\") " pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:24.544649 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.544615    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:24.825828 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:24.825798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9vdtp"]
Jul 15 23:41:24.839137 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:41:24.839099    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcb4a75_263f_4662_a4a5_7a56ee3fcac8.slice/crio-7074724ab1b8caf4d8d76f73a355e53c49017ff8994f9e543e9dc5f59709a673 WatchSource:0}: Error finding container 7074724ab1b8caf4d8d76f73a355e53c49017ff8994f9e543e9dc5f59709a673: Status 404 returned error can't find the container with id 7074724ab1b8caf4d8d76f73a355e53c49017ff8994f9e543e9dc5f59709a673
Jul 15 23:41:25.351939 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:25.351902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp" event={"ID":"5fcb4a75-263f-4662-a4a5-7a56ee3fcac8","Type":"ContainerStarted","Data":"7074724ab1b8caf4d8d76f73a355e53c49017ff8994f9e543e9dc5f59709a673"}
Jul 15 23:41:26.358063 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.358027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp" event={"ID":"5fcb4a75-263f-4662-a4a5-7a56ee3fcac8","Type":"ContainerStarted","Data":"6e628964fdc0f5cbb36edbe8b3f44bfdebc773e2ac8fcbb0a127a998f5c4fd19"}
Jul 15 23:41:26.359513 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.359474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r885t" event={"ID":"c210fa57-cf61-4b97-99ae-e2c0b026cc96","Type":"ContainerStarted","Data":"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"}
Jul 15 23:41:26.359631 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.359566    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r885t" podUID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" containerName="registry-server" containerID="cri-o://e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42" gracePeriod=2
Jul 15 23:41:26.373817 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.373778    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp" podStartSLOduration=1.353742002 podStartE2EDuration="2.373762669s" totalImagesPullingTime="1.020020667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:41:26.373071054 +0000 UTC m=+331.904900045" watchObservedRunningTime="2026-07-15 23:41:26.373762669 +0000 UTC m=+331.905591635"
Jul 15 23:41:26.388777 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.388739    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r885t" podStartSLOduration=1.634992423 podStartE2EDuration="3.388724608s" totalImagesPullingTime="1.753732185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:41:26.38757313 +0000 UTC m=+331.919402109" watchObservedRunningTime="2026-07-15 23:41:26.388724608 +0000 UTC m=+331.920553597"
Jul 15 23:41:26.597786 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.597763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:26.665902 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.665817    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwrlr\" (UniqueName: \"kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr\") pod \"c210fa57-cf61-4b97-99ae-e2c0b026cc96\" (UID: \"c210fa57-cf61-4b97-99ae-e2c0b026cc96\") "
Jul 15 23:41:26.667995 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.667968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr" (OuterVolumeSpecName: "kube-api-access-cwrlr") pod "c210fa57-cf61-4b97-99ae-e2c0b026cc96" (UID: "c210fa57-cf61-4b97-99ae-e2c0b026cc96"). InnerVolumeSpecName "kube-api-access-cwrlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:41:26.766582 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:26.766543    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwrlr\" (UniqueName: \"kubernetes.io/projected/c210fa57-cf61-4b97-99ae-e2c0b026cc96-kube-api-access-cwrlr\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:41:27.364185 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.364154    2578 generic.go:356] "Generic (PLEG): container finished" podID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" containerID="e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42" exitCode=0
Jul 15 23:41:27.364623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.364193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r885t" event={"ID":"c210fa57-cf61-4b97-99ae-e2c0b026cc96","Type":"ContainerDied","Data":"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"}
Jul 15 23:41:27.364623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.364260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r885t" event={"ID":"c210fa57-cf61-4b97-99ae-e2c0b026cc96","Type":"ContainerDied","Data":"70a91f2dc2f4bdac0ef43735e08e768a26fca958413d575a4a324fdc772c7ee8"}
Jul 15 23:41:27.364623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.364208    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r885t"
Jul 15 23:41:27.364623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.364281    2578 scope.go:117] "RemoveContainer" containerID="e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"
Jul 15 23:41:27.372678 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.372656    2578 scope.go:117] "RemoveContainer" containerID="e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"
Jul 15 23:41:27.372952 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:41:27.372934    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42\": container with ID starting with e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42 not found: ID does not exist" containerID="e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"
Jul 15 23:41:27.373001 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.372962    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42"} err="failed to get container status \"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42\": rpc error: code = NotFound desc = could not find container \"e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42\": container with ID starting with e1f92ae79ffa8061d307c6a2317a2b2b5f065d40bd5e996dd0dfd376a2046f42 not found: ID does not exist"
Jul 15 23:41:27.379778 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.379756    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:27.383526 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:27.383481    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r885t"]
Jul 15 23:41:28.995081 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:28.995050    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" path="/var/lib/kubelet/pods/c210fa57-cf61-4b97-99ae-e2c0b026cc96/volumes"
Jul 15 23:41:34.544871 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:34.544819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:34.545325 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:34.544907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:34.567931 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:34.567902    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:35.415229 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:35.415206    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9vdtp"
Jul 15 23:41:55.426322 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.426292    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"]
Jul 15 23:41:55.426750 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.426605    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" containerName="registry-server"
Jul 15 23:41:55.426750 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.426616    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" containerName="registry-server"
Jul 15 23:41:55.426750 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.426676    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c210fa57-cf61-4b97-99ae-e2c0b026cc96" containerName="registry-server"
Jul 15 23:41:55.430639 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.430621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:55.433085 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.433059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nz98f\""
Jul 15 23:41:55.433203 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.433062    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 23:41:55.440197 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.440172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"]
Jul 15 23:41:55.495931 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.495897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxp2\" (UniqueName: \"kubernetes.io/projected/4b96f0f3-6578-419b-b2b0-dc137f914c2e-kube-api-access-rxxp2\") pod \"dns-operator-controller-manager-864dd78c4c-2zs6c\" (UID: \"4b96f0f3-6578-419b-b2b0-dc137f914c2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:55.596963 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.596925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxp2\" (UniqueName: \"kubernetes.io/projected/4b96f0f3-6578-419b-b2b0-dc137f914c2e-kube-api-access-rxxp2\") pod \"dns-operator-controller-manager-864dd78c4c-2zs6c\" (UID: \"4b96f0f3-6578-419b-b2b0-dc137f914c2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:55.607879 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.607847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxp2\" (UniqueName: \"kubernetes.io/projected/4b96f0f3-6578-419b-b2b0-dc137f914c2e-kube-api-access-rxxp2\") pod \"dns-operator-controller-manager-864dd78c4c-2zs6c\" (UID: \"4b96f0f3-6578-419b-b2b0-dc137f914c2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:55.740526 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.740410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:55.871520 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:55.871478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"]
Jul 15 23:41:55.873714 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:41:55.873686    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b96f0f3_6578_419b_b2b0_dc137f914c2e.slice/crio-55af358b80898280d1e2c5c1f6c67908c7daf024e35c89d7e0e625bd8c340977 WatchSource:0}: Error finding container 55af358b80898280d1e2c5c1f6c67908c7daf024e35c89d7e0e625bd8c340977: Status 404 returned error can't find the container with id 55af358b80898280d1e2c5c1f6c67908c7daf024e35c89d7e0e625bd8c340977
Jul 15 23:41:56.478422 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:56.478390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c" event={"ID":"4b96f0f3-6578-419b-b2b0-dc137f914c2e","Type":"ContainerStarted","Data":"55af358b80898280d1e2c5c1f6c67908c7daf024e35c89d7e0e625bd8c340977"}
Jul 15 23:41:58.490145 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.490102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c" event={"ID":"4b96f0f3-6578-419b-b2b0-dc137f914c2e","Type":"ContainerStarted","Data":"45d323aece826af95dc818d8d8f167e096c76053089faed9e0b6454951421dc5"}
Jul 15 23:41:58.490628 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.490243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:41:58.508794 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.508741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c" podStartSLOduration=1.465928774 podStartE2EDuration="3.508724786s" totalImagesPullingTime="2.042796012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:41:58.506750465 +0000 UTC m=+364.038579513" watchObservedRunningTime="2026-07-15 23:41:58.508724786 +0000 UTC m=+364.040553773"
Jul 15 23:41:58.901509 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.901470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"]
Jul 15 23:41:58.904788 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.904769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:41:58.907257 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.907238    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5rdqs\""
Jul 15 23:41:58.913906 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:58.913878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"]
Jul 15 23:41:59.027293 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.027254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbnmc\" (UniqueName: \"kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" (UID: \"20d98434-73aa-4da9-ba70-44a1762dece0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:41:59.128607 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.128568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbnmc\" (UniqueName: \"kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" (UID: \"20d98434-73aa-4da9-ba70-44a1762dece0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:41:59.136874 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.136845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbnmc\" (UniqueName: \"kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" (UID: \"20d98434-73aa-4da9-ba70-44a1762dece0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:41:59.215143 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.215048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:41:59.352166 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.351558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"]
Jul 15 23:41:59.354402 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:41:59.354372    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d98434_73aa_4da9_ba70_44a1762dece0.slice/crio-7e8de53c58471fdc34cd0b7cec46c724f9dca24ab1f58a1072624c16cda37e46 WatchSource:0}: Error finding container 7e8de53c58471fdc34cd0b7cec46c724f9dca24ab1f58a1072624c16cda37e46: Status 404 returned error can't find the container with id 7e8de53c58471fdc34cd0b7cec46c724f9dca24ab1f58a1072624c16cda37e46
Jul 15 23:41:59.495301 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:41:59.495204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc" event={"ID":"20d98434-73aa-4da9-ba70-44a1762dece0","Type":"ContainerStarted","Data":"7e8de53c58471fdc34cd0b7cec46c724f9dca24ab1f58a1072624c16cda37e46"}
Jul 15 23:42:01.505221 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:01.505188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc" event={"ID":"20d98434-73aa-4da9-ba70-44a1762dece0","Type":"ContainerStarted","Data":"f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816"}
Jul 15 23:42:01.505675 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:01.505274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:01.521468 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:01.521422    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc" podStartSLOduration=1.896914352 podStartE2EDuration="3.521405641s" totalImagesPullingTime="1.624491289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:01.52039998 +0000 UTC m=+367.052228972" watchObservedRunningTime="2026-07-15 23:42:01.521405641 +0000 UTC m=+367.053234682"
Jul 15 23:42:02.696387 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.696353    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"]
Jul 15 23:42:02.699742 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.699723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:02.702735 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.702710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6ztgq\""
Jul 15 23:42:02.716012 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.715981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"]
Jul 15 23:42:02.759831 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.759790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrqj\" (UniqueName: \"kubernetes.io/projected/d309bdae-e98b-4c1e-b41b-8e91e23550f1-kube-api-access-6hrqj\") pod \"authorino-operator-75cc8d5cb7-k6vnd\" (UID: \"d309bdae-e98b-4c1e-b41b-8e91e23550f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:02.861007 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.860969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrqj\" (UniqueName: \"kubernetes.io/projected/d309bdae-e98b-4c1e-b41b-8e91e23550f1-kube-api-access-6hrqj\") pod \"authorino-operator-75cc8d5cb7-k6vnd\" (UID: \"d309bdae-e98b-4c1e-b41b-8e91e23550f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:02.869050 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:02.869023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrqj\" (UniqueName: \"kubernetes.io/projected/d309bdae-e98b-4c1e-b41b-8e91e23550f1-kube-api-access-6hrqj\") pod \"authorino-operator-75cc8d5cb7-k6vnd\" (UID: \"d309bdae-e98b-4c1e-b41b-8e91e23550f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:03.010365 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:03.010339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:03.144175 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:03.144155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"]
Jul 15 23:42:03.146651 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:03.146624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd309bdae_e98b_4c1e_b41b_8e91e23550f1.slice/crio-92fc2dfca3de2741e20635dc68c18508016bd1c09e88190bebb54351a2145480 WatchSource:0}: Error finding container 92fc2dfca3de2741e20635dc68c18508016bd1c09e88190bebb54351a2145480: Status 404 returned error can't find the container with id 92fc2dfca3de2741e20635dc68c18508016bd1c09e88190bebb54351a2145480
Jul 15 23:42:03.514982 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:03.514952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd" event={"ID":"d309bdae-e98b-4c1e-b41b-8e91e23550f1","Type":"ContainerStarted","Data":"92fc2dfca3de2741e20635dc68c18508016bd1c09e88190bebb54351a2145480"}
Jul 15 23:42:06.530427 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:06.530387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd" event={"ID":"d309bdae-e98b-4c1e-b41b-8e91e23550f1","Type":"ContainerStarted","Data":"4bffa90635ecbc8b8c1d7d5229a5b15fcb7233d01807e9b5c25b044726299c3a"}
Jul 15 23:42:06.530875 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:06.530630    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:06.551431 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:06.551355    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd" podStartSLOduration=2.180057751 podStartE2EDuration="4.551339591s" totalImagesPullingTime="2.37128184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:06.550050466 +0000 UTC m=+372.081879460" watchObservedRunningTime="2026-07-15 23:42:06.551339591 +0000 UTC m=+372.083168656"
Jul 15 23:42:07.705804 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.705766    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"]
Jul 15 23:42:07.709136 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.709118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.712178 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.712155    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mq4mn\""
Jul 15 23:42:07.721301 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.721279    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"]
Jul 15 23:42:07.804393 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.804360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.804595 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.804427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26t4\" (UniqueName: \"kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.905741 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.905699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26t4\" (UniqueName: \"kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.905889 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.905760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.906100 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.906084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:07.915131 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:07.915104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26t4\" (UniqueName: \"kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:08.018353 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:08.018324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:08.153411 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:08.153388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"]
Jul 15 23:42:08.155738 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:08.155709    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25eba50e_8909_4344_b3e0_c026f5839d96.slice/crio-c8319fabce050589dbb897b9a5fe132ce582bac1262e38da9c7473ca5e4501d1 WatchSource:0}: Error finding container c8319fabce050589dbb897b9a5fe132ce582bac1262e38da9c7473ca5e4501d1: Status 404 returned error can't find the container with id c8319fabce050589dbb897b9a5fe132ce582bac1262e38da9c7473ca5e4501d1
Jul 15 23:42:08.540318 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:08.540285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp" event={"ID":"25eba50e-8909-4344-b3e0-c026f5839d96","Type":"ContainerStarted","Data":"c8319fabce050589dbb897b9a5fe132ce582bac1262e38da9c7473ca5e4501d1"}
Jul 15 23:42:09.497999 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:09.497971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2zs6c"
Jul 15 23:42:12.512280 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:12.512247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:13.569428 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:13.569399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp" event={"ID":"25eba50e-8909-4344-b3e0-c026f5839d96","Type":"ContainerStarted","Data":"f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c"}
Jul 15 23:42:13.569834 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:13.569542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:13.590853 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:13.590802    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp" podStartSLOduration=1.4998385349999999 podStartE2EDuration="6.590787862s" totalImagesPullingTime="5.090949327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:13.588879925 +0000 UTC m=+379.120708916" watchObservedRunningTime="2026-07-15 23:42:13.590787862 +0000 UTC m=+379.122616850"
Jul 15 23:42:15.893033 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.892997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"]
Jul 15 23:42:15.896478 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.896457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:15.898719 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.898695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 23:42:15.898835 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.898812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 23:42:15.898899 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.898812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnjq2\""
Jul 15 23:42:15.904641 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:15.904610    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"]
Jul 15 23:42:16.076196 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.076159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7b6a1f-7189-4e3f-b069-a409bfe79609-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.076390 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.076267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpgh5\" (UniqueName: \"kubernetes.io/projected/5e7b6a1f-7189-4e3f-b069-a409bfe79609-kube-api-access-kpgh5\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.076390 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.076311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e7b6a1f-7189-4e3f-b069-a409bfe79609-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.177591 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.177502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpgh5\" (UniqueName: \"kubernetes.io/projected/5e7b6a1f-7189-4e3f-b069-a409bfe79609-kube-api-access-kpgh5\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.177591 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.177563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e7b6a1f-7189-4e3f-b069-a409bfe79609-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.177813 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.177640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7b6a1f-7189-4e3f-b069-a409bfe79609-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.178199 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.178175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e7b6a1f-7189-4e3f-b069-a409bfe79609-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.180068 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.180044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7b6a1f-7189-4e3f-b069-a409bfe79609-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.185573 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.185550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpgh5\" (UniqueName: \"kubernetes.io/projected/5e7b6a1f-7189-4e3f-b069-a409bfe79609-kube-api-access-kpgh5\") pod \"kuadrant-console-plugin-66b5774985-xfrvq\" (UID: \"5e7b6a1f-7189-4e3f-b069-a409bfe79609\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.208404 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.208378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"
Jul 15 23:42:16.358058 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.358034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq"]
Jul 15 23:42:16.359801 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:16.359777    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e7b6a1f_7189_4e3f_b069_a409bfe79609.slice/crio-328d34c689df6f43e9b7cbbc87824b53f2457a7f250cc9fc2178077c4b8494cc WatchSource:0}: Error finding container 328d34c689df6f43e9b7cbbc87824b53f2457a7f250cc9fc2178077c4b8494cc: Status 404 returned error can't find the container with id 328d34c689df6f43e9b7cbbc87824b53f2457a7f250cc9fc2178077c4b8494cc
Jul 15 23:42:16.583432 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:16.583395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq" event={"ID":"5e7b6a1f-7189-4e3f-b069-a409bfe79609","Type":"ContainerStarted","Data":"328d34c689df6f43e9b7cbbc87824b53f2457a7f250cc9fc2178077c4b8494cc"}
Jul 15 23:42:17.537966 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:17.537930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6vnd"
Jul 15 23:42:24.576866 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:24.576830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:26.313933 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.313893    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"]
Jul 15 23:42:26.314419 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.314136    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" containerName="manager" containerID="cri-o://f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c" gracePeriod=2
Jul 15 23:42:26.327925 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:26.327877    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"25eba50e-8909-4344-b3e0-c026f5839d96\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:26.329713 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.329643    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"]
Jul 15 23:42:26.337202 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.337178    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:26.337687 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.337665    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" containerName="manager"
Jul 15 23:42:26.337687 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.337688    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" containerName="manager"
Jul 15 23:42:26.337872 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.337782    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" containerName="manager"
Jul 15 23:42:26.349832 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.349659    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"]
Jul 15 23:42:26.349832 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.349719    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"]
Jul 15 23:42:26.350284 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.349890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.350284 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.350174    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" containerName="manager" containerID="cri-o://f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816" gracePeriod=2
Jul 15 23:42:26.363224 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.363198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:26.367116 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.367090    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"]
Jul 15 23:42:26.367635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.367616    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" containerName="manager"
Jul 15 23:42:26.367635 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.367636    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" containerName="manager"
Jul 15 23:42:26.367783 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.367703    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" containerName="manager"
Jul 15 23:42:26.368859 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.368832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfr44\" (UniqueName: \"kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.368965 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.368942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.370895 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.370875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:26.379679 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.379655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"]
Jul 15 23:42:26.387142 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:26.387104    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:26.388950 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:26.388914    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:26.390851 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:26.390792    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:26.392609 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:26.392569    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:26.469835 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.469797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.470013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.469854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvt5\" (UniqueName: \"kubernetes.io/projected/40bd4a10-2157-4b2a-af33-42d35db3b9d8-kube-api-access-dlvt5\") pod \"limitador-operator-controller-manager-859d7b78bd-wg9xb\" (UID: \"40bd4a10-2157-4b2a-af33-42d35db3b9d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:26.470013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.469949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfr44\" (UniqueName: \"kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.470202 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.470179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.478402 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.478375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfr44\" (UniqueName: \"kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gbdmk\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.570650 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.570559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvt5\" (UniqueName: \"kubernetes.io/projected/40bd4a10-2157-4b2a-af33-42d35db3b9d8-kube-api-access-dlvt5\") pod \"limitador-operator-controller-manager-859d7b78bd-wg9xb\" (UID: \"40bd4a10-2157-4b2a-af33-42d35db3b9d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:26.579500 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.579456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvt5\" (UniqueName: \"kubernetes.io/projected/40bd4a10-2157-4b2a-af33-42d35db3b9d8-kube-api-access-dlvt5\") pod \"limitador-operator-controller-manager-859d7b78bd-wg9xb\" (UID: \"40bd4a10-2157-4b2a-af33-42d35db3b9d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:26.743211 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.743175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:26.749307 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:26.749272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:37.863594 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.863567    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:37.866101 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:37.866058    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:37.873115 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.873085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:37.873886 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.873860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"]
Jul 15 23:42:37.875384 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:37.875355    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:37.877333 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:37.877309    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:37.879483 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:37.879459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bd4a10_2157_4b2a_af33_42d35db3b9d8.slice/crio-76df15155b952bf724fa225f01b9ae3b4575e6a14c067db5be1ad6a38049dca6 WatchSource:0}: Error finding container 76df15155b952bf724fa225f01b9ae3b4575e6a14c067db5be1ad6a38049dca6: Status 404 returned error can't find the container with id 76df15155b952bf724fa225f01b9ae3b4575e6a14c067db5be1ad6a38049dca6
Jul 15 23:42:37.905431 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.905408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:37.912666 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:37.912638    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb59ddef_34ed_43b5_8786_8c4142b7698b.slice/crio-9727010e9872eb553c071d415b45860bad89e6e560d212f99832e4c901901f75 WatchSource:0}: Error finding container 9727010e9872eb553c071d415b45860bad89e6e560d212f99832e4c901901f75: Status 404 returned error can't find the container with id 9727010e9872eb553c071d415b45860bad89e6e560d212f99832e4c901901f75
Jul 15 23:42:37.971886 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.971859    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z26t4\" (UniqueName: \"kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4\") pod \"25eba50e-8909-4344-b3e0-c026f5839d96\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") "
Jul 15 23:42:37.972014 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.971920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume\") pod \"25eba50e-8909-4344-b3e0-c026f5839d96\" (UID: \"25eba50e-8909-4344-b3e0-c026f5839d96\") "
Jul 15 23:42:37.972014 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.971952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbnmc\" (UniqueName: \"kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc\") pod \"20d98434-73aa-4da9-ba70-44a1762dece0\" (UID: \"20d98434-73aa-4da9-ba70-44a1762dece0\") "
Jul 15 23:42:37.972468 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.972444    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "25eba50e-8909-4344-b3e0-c026f5839d96" (UID: "25eba50e-8909-4344-b3e0-c026f5839d96"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:42:37.973944 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.973911    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4" (OuterVolumeSpecName: "kube-api-access-z26t4") pod "25eba50e-8909-4344-b3e0-c026f5839d96" (UID: "25eba50e-8909-4344-b3e0-c026f5839d96"). InnerVolumeSpecName "kube-api-access-z26t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:42:37.974129 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:37.973972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc" (OuterVolumeSpecName: "kube-api-access-rbnmc") pod "20d98434-73aa-4da9-ba70-44a1762dece0" (UID: "20d98434-73aa-4da9-ba70-44a1762dece0"). InnerVolumeSpecName "kube-api-access-rbnmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:42:38.073162 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.073130    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z26t4\" (UniqueName: \"kubernetes.io/projected/25eba50e-8909-4344-b3e0-c026f5839d96-kube-api-access-z26t4\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:42:38.073162 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.073157    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eba50e-8909-4344-b3e0-c026f5839d96-extensions-socket-volume\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:42:38.073162 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.073167    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbnmc\" (UniqueName: \"kubernetes.io/projected/20d98434-73aa-4da9-ba70-44a1762dece0-kube-api-access-rbnmc\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:42:38.692983 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.692943    2578 generic.go:356] "Generic (PLEG): container finished" podID="25eba50e-8909-4344-b3e0-c026f5839d96" containerID="f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c" exitCode=0
Jul 15 23:42:38.693178 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.692993    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:38.693178 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.693038    2578 scope.go:117] "RemoveContainer" containerID="f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c"
Jul 15 23:42:38.694958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.694934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" event={"ID":"db59ddef-34ed-43b5-8786-8c4142b7698b","Type":"ContainerStarted","Data":"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"}
Jul 15 23:42:38.695071 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.694985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" event={"ID":"db59ddef-34ed-43b5-8786-8c4142b7698b","Type":"ContainerStarted","Data":"9727010e9872eb553c071d415b45860bad89e6e560d212f99832e4c901901f75"}
Jul 15 23:42:38.695071 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.695017    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:38.695423 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.695388    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:38.696623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.696602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb" event={"ID":"40bd4a10-2157-4b2a-af33-42d35db3b9d8","Type":"ContainerStarted","Data":"5dc6a52360511b272800ea5b86194ea59a5fb8745e4ef9d99db713d9ace1d3ee"}
Jul 15 23:42:38.696720 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.696644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb" event={"ID":"40bd4a10-2157-4b2a-af33-42d35db3b9d8","Type":"ContainerStarted","Data":"76df15155b952bf724fa225f01b9ae3b4575e6a14c067db5be1ad6a38049dca6"}
Jul 15 23:42:38.696785 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.696749    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:38.697344 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.697314    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:38.698025 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.698004    2578 generic.go:356] "Generic (PLEG): container finished" podID="20d98434-73aa-4da9-ba70-44a1762dece0" containerID="f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816" exitCode=0
Jul 15 23:42:38.698109 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.698044    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:38.699520 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.699479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq" event={"ID":"5e7b6a1f-7189-4e3f-b069-a409bfe79609","Type":"ContainerStarted","Data":"abb89efdc971cec01fa9a939bd2d88530744e7ffc703c7f54f03efc756d8c361"}
Jul 15 23:42:38.716850 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.716815    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:38.717029 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.716995    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" podStartSLOduration=12.716965524999999 podStartE2EDuration="12.716965525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:38.714893659 +0000 UTC m=+404.246722646" watchObservedRunningTime="2026-07-15 23:42:38.716965525 +0000 UTC m=+404.248794513"
Jul 15 23:42:38.718621 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.718589    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:38.722129 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.722024    2578 scope.go:117] "RemoveContainer" containerID="f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c"
Jul 15 23:42:38.722386 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.722360    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c\": container with ID starting with f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c not found: ID does not exist" containerID="f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c"
Jul 15 23:42:38.722484 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.722400    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c"} err="failed to get container status \"f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c\": rpc error: code = NotFound desc = could not find container \"f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c\": container with ID starting with f5106e1d9e9c7ed59750a7e847aae9333ef867089a2f68dce76f81b5e750248c not found: ID does not exist"
Jul 15 23:42:38.722484 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.722426    2578 scope.go:117] "RemoveContainer" containerID="f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816"
Jul 15 23:42:38.730361 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.730340    2578 scope.go:117] "RemoveContainer" containerID="f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816"
Jul 15 23:42:38.730650 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.730633    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816\": container with ID starting with f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816 not found: ID does not exist" containerID="f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816"
Jul 15 23:42:38.730721 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.730657    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816"} err="failed to get container status \"f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816\": rpc error: code = NotFound desc = could not find container \"f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816\": container with ID starting with f90e4181262531e0db958def0bca2b9540330fc1b914f200c7568763cb55f816 not found: ID does not exist"
Jul 15 23:42:38.738187 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.738139    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb" podStartSLOduration=12.73812277 podStartE2EDuration="12.73812277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:38.736297242 +0000 UTC m=+404.268126232" watchObservedRunningTime="2026-07-15 23:42:38.73812277 +0000 UTC m=+404.269951755"
Jul 15 23:42:38.751233 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.751186    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xfrvq" podStartSLOduration=2.327522485 podStartE2EDuration="23.751171118s" totalImagesPullingTime="21.423648633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:38.750433557 +0000 UTC m=+404.282262546" watchObservedRunningTime="2026-07-15 23:42:38.751171118 +0000 UTC m=+404.283000106"
Jul 15 23:42:38.752539 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.752512    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwtlp\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwtlp"
Jul 15 23:42:38.754295 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:38.754269    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wgnc\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wgnc"
Jul 15 23:42:38.996459 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.996375    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d98434-73aa-4da9-ba70-44a1762dece0" path="/var/lib/kubelet/pods/20d98434-73aa-4da9-ba70-44a1762dece0/volumes"
Jul 15 23:42:38.996818 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:38.996729    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25eba50e-8909-4344-b3e0-c026f5839d96" path="/var/lib/kubelet/pods/25eba50e-8909-4344-b3e0-c026f5839d96/volumes"
Jul 15 23:42:41.955024 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:41.954990    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:41.955443 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:41.955206    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" podUID="db59ddef-34ed-43b5-8786-8c4142b7698b" containerName="manager" containerID="cri-o://e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9" gracePeriod=10
Jul 15 23:42:42.148625 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.148590    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:42:42.151432 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.151408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.169770 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.169739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:42:42.201120 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.201093    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:42.213338 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.213254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.213338 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.213324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4bj9\" (UniqueName: \"kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.313987 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.313950    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume\") pod \"db59ddef-34ed-43b5-8786-8c4142b7698b\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") "
Jul 15 23:42:42.314137 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.314020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfr44\" (UniqueName: \"kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44\") pod \"db59ddef-34ed-43b5-8786-8c4142b7698b\" (UID: \"db59ddef-34ed-43b5-8786-8c4142b7698b\") "
Jul 15 23:42:42.314137 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.314120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4bj9\" (UniqueName: \"kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.314240 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.314199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.314389 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.314360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db59ddef-34ed-43b5-8786-8c4142b7698b" (UID: "db59ddef-34ed-43b5-8786-8c4142b7698b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:42:42.314643 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.314621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.316262 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.316243    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44" (OuterVolumeSpecName: "kube-api-access-sfr44") pod "db59ddef-34ed-43b5-8786-8c4142b7698b" (UID: "db59ddef-34ed-43b5-8786-8c4142b7698b"). InnerVolumeSpecName "kube-api-access-sfr44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:42:42.327674 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.327650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4bj9\" (UniqueName: \"kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9\") pod \"kuadrant-operator-controller-manager-86878c769f-sgsxf\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.415652 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.415613    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db59ddef-34ed-43b5-8786-8c4142b7698b-extensions-socket-volume\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:42:42.415652 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.415643    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfr44\" (UniqueName: \"kubernetes.io/projected/db59ddef-34ed-43b5-8786-8c4142b7698b-kube-api-access-sfr44\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:42:42.464051 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.463967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.602508 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.602456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:42:42.606471 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:42:42.606440    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49af2b7b_1df4_43c6_a2b6_d9f798b03a6c.slice/crio-8ff93c42bd5a2329d60a8483e78fe036931748f29bcaecac6a3d0c4850449eb1 WatchSource:0}: Error finding container 8ff93c42bd5a2329d60a8483e78fe036931748f29bcaecac6a3d0c4850449eb1: Status 404 returned error can't find the container with id 8ff93c42bd5a2329d60a8483e78fe036931748f29bcaecac6a3d0c4850449eb1
Jul 15 23:42:42.721840 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.721738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" event={"ID":"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c","Type":"ContainerStarted","Data":"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"}
Jul 15 23:42:42.721840 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.721802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" event={"ID":"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c","Type":"ContainerStarted","Data":"8ff93c42bd5a2329d60a8483e78fe036931748f29bcaecac6a3d0c4850449eb1"}
Jul 15 23:42:42.721840 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.721835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:42:42.723005 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.722977    2578 generic.go:356] "Generic (PLEG): container finished" podID="db59ddef-34ed-43b5-8786-8c4142b7698b" containerID="e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9" exitCode=0
Jul 15 23:42:42.723090 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.723014    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"
Jul 15 23:42:42.723090 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.723040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" event={"ID":"db59ddef-34ed-43b5-8786-8c4142b7698b","Type":"ContainerDied","Data":"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"}
Jul 15 23:42:42.723090 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.723076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk" event={"ID":"db59ddef-34ed-43b5-8786-8c4142b7698b","Type":"ContainerDied","Data":"9727010e9872eb553c071d415b45860bad89e6e560d212f99832e4c901901f75"}
Jul 15 23:42:42.723203 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.723096    2578 scope.go:117] "RemoveContainer" containerID="e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"
Jul 15 23:42:42.731447 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.731430    2578 scope.go:117] "RemoveContainer" containerID="e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"
Jul 15 23:42:42.731759 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:42:42.731741    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9\": container with ID starting with e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9 not found: ID does not exist" containerID="e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"
Jul 15 23:42:42.731810 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.731770    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9"} err="failed to get container status \"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9\": rpc error: code = NotFound desc = could not find container \"e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9\": container with ID starting with e00b3c80499705321ba37f24355d8694b5dbcaadfc0b4bf47cf60aea9d0ddac9 not found: ID does not exist"
Jul 15 23:42:42.740658 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.740606    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" podStartSLOduration=0.740585114 podStartE2EDuration="740.585114ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:42:42.739396959 +0000 UTC m=+408.271225952" watchObservedRunningTime="2026-07-15 23:42:42.740585114 +0000 UTC m=+408.272414105"
Jul 15 23:42:42.753337 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.753312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:42.756370 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:42.756346    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gbdmk"]
Jul 15 23:42:43.001541 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:43.001434    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db59ddef-34ed-43b5-8786-8c4142b7698b" path="/var/lib/kubelet/pods/db59ddef-34ed-43b5-8786-8c4142b7698b/volumes"
Jul 15 23:42:49.707923 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:49.707892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg9xb"
Jul 15 23:42:53.731264 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:42:53.731228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:43:15.013039 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.013009    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:43:15.013547 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.013368    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db59ddef-34ed-43b5-8786-8c4142b7698b" containerName="manager"
Jul 15 23:43:15.013547 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.013381    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db59ddef-34ed-43b5-8786-8c4142b7698b" containerName="manager"
Jul 15 23:43:15.013547 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.013427    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db59ddef-34ed-43b5-8786-8c4142b7698b" containerName="manager"
Jul 15 23:43:15.063763 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.063735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:43:15.063922 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.063776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:43:15.063922 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.063858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.066529 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.066447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 23:43:15.102581 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.102552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmfq\" (UniqueName: \"kubernetes.io/projected/f95158ba-296d-4359-87c5-c3e6afcdc62f-kube-api-access-knmfq\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.102734 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.102591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f95158ba-296d-4359-87c5-c3e6afcdc62f-config-file\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.203558 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.203514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmfq\" (UniqueName: \"kubernetes.io/projected/f95158ba-296d-4359-87c5-c3e6afcdc62f-kube-api-access-knmfq\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.203726 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.203569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f95158ba-296d-4359-87c5-c3e6afcdc62f-config-file\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.204233 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.204212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f95158ba-296d-4359-87c5-c3e6afcdc62f-config-file\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.211475 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.211440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmfq\" (UniqueName: \"kubernetes.io/projected/f95158ba-296d-4359-87c5-c3e6afcdc62f-kube-api-access-knmfq\") pod \"limitador-limitador-54d6d988d5-9dv2l\" (UID: \"f95158ba-296d-4359-87c5-c3e6afcdc62f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.378473 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.378372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:15.521382 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.521280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:43:15.523785 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:43:15.523757    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95158ba_296d_4359_87c5_c3e6afcdc62f.slice/crio-fb7de8d9a1c26f77a61e22aab4a24ea7bf9d50c2d92ff7cdfbc61a68b3237409 WatchSource:0}: Error finding container fb7de8d9a1c26f77a61e22aab4a24ea7bf9d50c2d92ff7cdfbc61a68b3237409: Status 404 returned error can't find the container with id fb7de8d9a1c26f77a61e22aab4a24ea7bf9d50c2d92ff7cdfbc61a68b3237409
Jul 15 23:43:15.868392 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:15.868352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l" event={"ID":"f95158ba-296d-4359-87c5-c3e6afcdc62f","Type":"ContainerStarted","Data":"fb7de8d9a1c26f77a61e22aab4a24ea7bf9d50c2d92ff7cdfbc61a68b3237409"}
Jul 15 23:43:18.883371 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:18.883332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l" event={"ID":"f95158ba-296d-4359-87c5-c3e6afcdc62f","Type":"ContainerStarted","Data":"25693ca69257b1f197e1e6040f110bcdc6317d3f8e0f6f847113109e8cfa3063"}
Jul 15 23:43:18.883763 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:18.883412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:43:18.898907 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:18.898862    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l" podStartSLOduration=2.4732490990000002 podStartE2EDuration="4.898847389s" totalImagesPullingTime="2.42559829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:43:18.897326417 +0000 UTC m=+444.429155405" watchObservedRunningTime="2026-07-15 23:43:18.898847389 +0000 UTC m=+444.430676396"
Jul 15 23:43:29.889319 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:43:29.889285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"
Jul 15 23:44:26.007581 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:44:26.007547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:44:40.583190 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:44:40.583150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:44:48.791564 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:44:48.791467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:45:05.387611 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:05.387576    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:45:43.187623 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:43.187589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:45:53.287045 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.287005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"]
Jul 15 23:45:53.289448 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.289428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.291817 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.291791    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 23:45:53.292909 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.292889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 23:45:53.293013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.292910    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 23:45:53.293013 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.292910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j2wfm\""
Jul 15 23:45:53.299148 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.299123    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"]
Jul 15 23:45:53.328991 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.328959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a80acb7-4772-4d0a-b95c-568c67421416-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.329126 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.329021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.329126 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.329055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.329126 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.329071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wptmf\" (UniqueName: \"kubernetes.io/projected/7a80acb7-4772-4d0a-b95c-568c67421416-kube-api-access-wptmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.329250 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.329148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.329250 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.329183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429794 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a80acb7-4772-4d0a-b95c-568c67421416-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429980 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429980 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429980 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wptmf\" (UniqueName: \"kubernetes.io/projected/7a80acb7-4772-4d0a-b95c-568c67421416-kube-api-access-wptmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429980 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.429980 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.429901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.430274 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.430250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.430356 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.430334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.430413 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.430382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.432206 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.432178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a80acb7-4772-4d0a-b95c-568c67421416-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.432432 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.432407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a80acb7-4772-4d0a-b95c-568c67421416-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.437286 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.437266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wptmf\" (UniqueName: \"kubernetes.io/projected/7a80acb7-4772-4d0a-b95c-568c67421416-kube-api-access-wptmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jwwdk\" (UID: \"7a80acb7-4772-4d0a-b95c-568c67421416\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.600241 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.600155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:45:53.736589 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:53.736559    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"]
Jul 15 23:45:53.738815 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:45:53.738790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a80acb7_4772_4d0a_b95c_568c67421416.slice/crio-d462b5432a96a6a551268594aa3d75b57feff694ea2f645b33ee1dde977058d9 WatchSource:0}: Error finding container d462b5432a96a6a551268594aa3d75b57feff694ea2f645b33ee1dde977058d9: Status 404 returned error can't find the container with id d462b5432a96a6a551268594aa3d75b57feff694ea2f645b33ee1dde977058d9
Jul 15 23:45:54.562447 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:54.562412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk" event={"ID":"7a80acb7-4772-4d0a-b95c-568c67421416","Type":"ContainerStarted","Data":"d462b5432a96a6a551268594aa3d75b57feff694ea2f645b33ee1dde977058d9"}
Jul 15 23:45:55.568465 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:55.568431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk" event={"ID":"7a80acb7-4772-4d0a-b95c-568c67421416","Type":"ContainerStarted","Data":"c2802da5d92cb1bf7f5b5a2c6c5b9c85b85ab80e66f98338c0f10e17b76f01cb"}
Jul 15 23:45:55.588564 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:55.588514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk" podStartSLOduration=1.484469976 podStartE2EDuration="2.588472682s" totalImagesPullingTime="1.104002706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:45:55.587376056 +0000 UTC m=+601.119205045" watchObservedRunningTime="2026-07-15 23:45:55.588472682 +0000 UTC m=+601.120301664"
Jul 15 23:45:55.700825 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:45:55.700790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:46:03.600306 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:03.600257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:46:03.600751 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:03.600350    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:46:03.613451 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:03.613425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:46:04.619538 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:04.619503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jwwdk"
Jul 15 23:46:06.190748 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.190714    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"]
Jul 15 23:46:06.193510 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.193467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.196094 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.196074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 23:46:06.203385 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.203358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"]
Jul 15 23:46:06.235079 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.235265 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.235265 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.235265 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrbv\" (UniqueName: \"kubernetes.io/projected/ea78c7e6-c0d0-4562-a933-e1c4904248b8-kube-api-access-hhrbv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.235436 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.235436 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.235324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336707 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrbv\" (UniqueName: \"kubernetes.io/projected/ea78c7e6-c0d0-4562-a933-e1c4904248b8-kube-api-access-hhrbv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336707 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.336992 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.336940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.337321 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.337262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.337454 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.337432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.337514 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.337457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.339020 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.338991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea78c7e6-c0d0-4562-a933-e1c4904248b8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.339306 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.339286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea78c7e6-c0d0-4562-a933-e1c4904248b8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.343785 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.343766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrbv\" (UniqueName: \"kubernetes.io/projected/ea78c7e6-c0d0-4562-a933-e1c4904248b8-kube-api-access-hhrbv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks\" (UID: \"ea78c7e6-c0d0-4562-a933-e1c4904248b8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.503306 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.503210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:06.638225 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:06.638203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"]
Jul 15 23:46:06.640055 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:46:06.640025    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea78c7e6_c0d0_4562_a933_e1c4904248b8.slice/crio-f0879cc9b7cf626d48fe1c42155d4ff2e23a16a9c8ab7468237ac8e6d82e71cc WatchSource:0}: Error finding container f0879cc9b7cf626d48fe1c42155d4ff2e23a16a9c8ab7468237ac8e6d82e71cc: Status 404 returned error can't find the container with id f0879cc9b7cf626d48fe1c42155d4ff2e23a16a9c8ab7468237ac8e6d82e71cc
Jul 15 23:46:07.623414 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:07.623372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks" event={"ID":"ea78c7e6-c0d0-4562-a933-e1c4904248b8","Type":"ContainerStarted","Data":"c63beef1f35c86862d69d11c5f1361ba98283e34e098e596eb4ca078e627c24a"}
Jul 15 23:46:07.623414 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:07.623417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks" event={"ID":"ea78c7e6-c0d0-4562-a933-e1c4904248b8","Type":"ContainerStarted","Data":"f0879cc9b7cf626d48fe1c42155d4ff2e23a16a9c8ab7468237ac8e6d82e71cc"}
Jul 15 23:46:07.646325 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:07.646066    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks" podStartSLOduration=1.49785721 podStartE2EDuration="1.646014217s" totalImagesPullingTime="148.157007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:46:07.640053372 +0000 UTC m=+613.171882360" watchObservedRunningTime="2026-07-15 23:46:07.646014217 +0000 UTC m=+613.177843208"
Jul 15 23:46:08.885247 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:08.885201    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:46:16.503761 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:16.503726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:16.504258 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:16.503784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:16.516645 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:16.516616    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:46:16.675222 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:46:16.675198    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks"
Jul 15 23:47:38.202904 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:47:38.202867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:47:48.082250 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:47:48.082175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:47:58.692000 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:47:58.691961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:48:08.092193 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:48:08.092160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:48:18.092845 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:48:18.092812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:48:49.195946 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:48:49.195911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:49:01.985133 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:49:01.985099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:49:36.692847 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:49:36.692811    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:49:49.986997 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:49:49.986962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:49:59.889329 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:49:59.889297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:50:08.688314 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:50:08.688284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:50:19.188681 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:50:19.188646    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:50:28.784872 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:50:28.784840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:50:39.683939 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:50:39.683901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:50:49.401077 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:50:49.400995    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:51:11.791586 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:51:11.791554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:51:22.288349 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:51:22.288315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:51:46.500256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:51:46.500216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:51:56.794467 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:51:56.794431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:52:11.693985 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:52:11.693949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:52:23.601903 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:52:23.601821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:52:33.288080 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:52:33.288041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:52:42.689092 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:52:42.689053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:52:51.893479 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:52:51.893442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:53:16.527161 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:16.527125    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:53:16.527724 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:16.527335    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" podUID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" containerName="manager" containerID="cri-o://3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de" gracePeriod=10
Jul 15 23:53:19.088809 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.088751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:53:19.184360 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.184331    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4bj9\" (UniqueName: \"kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9\") pod \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") "
Jul 15 23:53:19.184548 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.184453    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume\") pod \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\" (UID: \"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c\") "
Jul 15 23:53:19.184807 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.184787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" (UID: "49af2b7b-1df4-43c6-a2b6-d9f798b03a6c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:19.186477 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.186455    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9" (OuterVolumeSpecName: "kube-api-access-b4bj9") pod "49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" (UID: "49af2b7b-1df4-43c6-a2b6-d9f798b03a6c"). InnerVolumeSpecName "kube-api-access-b4bj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:19.285989 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.285955    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-extensions-socket-volume\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:53:19.285989 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.285982    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4bj9\" (UniqueName: \"kubernetes.io/projected/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c-kube-api-access-b4bj9\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 15 23:53:19.532791 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.532756    2578 generic.go:356] "Generic (PLEG): container finished" podID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" containerID="3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de" exitCode=0
Jul 15 23:53:19.532958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.532801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"
Jul 15 23:53:19.532958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.532840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" event={"ID":"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c","Type":"ContainerDied","Data":"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"}
Jul 15 23:53:19.532958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.532897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf" event={"ID":"49af2b7b-1df4-43c6-a2b6-d9f798b03a6c","Type":"ContainerDied","Data":"8ff93c42bd5a2329d60a8483e78fe036931748f29bcaecac6a3d0c4850449eb1"}
Jul 15 23:53:19.532958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.532920    2578 scope.go:117] "RemoveContainer" containerID="3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"
Jul 15 23:53:19.542241 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.542224    2578 scope.go:117] "RemoveContainer" containerID="3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"
Jul 15 23:53:19.542571 ip-10-0-133-3 kubenswrapper[2578]: E0715 23:53:19.542486    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de\": container with ID starting with 3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de not found: ID does not exist" containerID="3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"
Jul 15 23:53:19.542571 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.542529    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de"} err="failed to get container status \"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de\": rpc error: code = NotFound desc = could not find container \"3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de\": container with ID starting with 3720782a485cd758efaee022b4a36f9172873cc61fc997dc5a4ad3d7434717de not found: ID does not exist"
Jul 15 23:53:19.555718 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.555698    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:53:19.561686 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:19.561667    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgsxf"]
Jul 15 23:53:20.995856 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:53:20.995818    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" path="/var/lib/kubelet/pods/49af2b7b-1df4-43c6-a2b6-d9f798b03a6c/volumes"
Jul 15 23:54:17.658431 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.658396    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"]
Jul 15 23:54:17.658891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.658744    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" containerName="manager"
Jul 15 23:54:17.658891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.658755    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" containerName="manager"
Jul 15 23:54:17.658891 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.658822    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49af2b7b-1df4-43c6-a2b6-d9f798b03a6c" containerName="manager"
Jul 15 23:54:17.662967 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.662951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.665643 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.665625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mq4mn\""
Jul 15 23:54:17.673614 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.673593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"]
Jul 15 23:54:17.782817 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.782779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.782996 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.782857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg8dv\" (UniqueName: \"kubernetes.io/projected/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-kube-api-access-dg8dv\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.884140 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.884103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg8dv\" (UniqueName: \"kubernetes.io/projected/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-kube-api-access-dg8dv\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.884337 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.884161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.884539 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.884485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.894045 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.894022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg8dv\" (UniqueName: \"kubernetes.io/projected/75f96d50-1aa0-439f-a1dd-8c60fdeb757e-kube-api-access-dg8dv\") pod \"kuadrant-operator-controller-manager-86878c769f-px47n\" (UID: \"75f96d50-1aa0-439f-a1dd-8c60fdeb757e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:17.973998 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:17.973909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:18.113125 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:18.113094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"]
Jul 15 23:54:18.116409 ip-10-0-133-3 kubenswrapper[2578]: W0715 23:54:18.116385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f96d50_1aa0_439f_a1dd_8c60fdeb757e.slice/crio-5be9c46f4775e7e0d341fa031be69d580088291f56a35b11be62bb336380a018 WatchSource:0}: Error finding container 5be9c46f4775e7e0d341fa031be69d580088291f56a35b11be62bb336380a018: Status 404 returned error can't find the container with id 5be9c46f4775e7e0d341fa031be69d580088291f56a35b11be62bb336380a018
Jul 15 23:54:18.795666 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:18.795624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n" event={"ID":"75f96d50-1aa0-439f-a1dd-8c60fdeb757e","Type":"ContainerStarted","Data":"40571f9536b5d0f62619d99655e5438297a7352d9d63fe56c3b1cbba44462305"}
Jul 15 23:54:18.796077 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:18.795688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n" event={"ID":"75f96d50-1aa0-439f-a1dd-8c60fdeb757e","Type":"ContainerStarted","Data":"5be9c46f4775e7e0d341fa031be69d580088291f56a35b11be62bb336380a018"}
Jul 15 23:54:18.796077 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:18.795764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:18.826646 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:18.826590    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n" podStartSLOduration=1.82657307 podStartE2EDuration="1.82657307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:18.824280859 +0000 UTC m=+1104.356109847" watchObservedRunningTime="2026-07-15 23:54:18.82657307 +0000 UTC m=+1104.358402058"
Jul 15 23:54:29.802988 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:29.802958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-px47n"
Jul 15 23:54:37.299939 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:37.299902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:54:49.090460 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:49.090427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:54:57.596638 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:54:57.596606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:55:09.788075 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:55:09.788039    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:55:19.582379 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:55:19.582301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:55:29.185532 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:55:29.185483    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:55:39.489101 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:55:39.489071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:55:48.884701 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:55:48.884662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:56:00.301107 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:56:00.301068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:56:09.684409 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:56:09.684366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:56:20.787364 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:56:20.787326    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:56:45.982793 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:56:45.982755    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:56:53.395073 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:56:53.394992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:03.092128 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:03.092095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:13.789075 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:13.789036    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:23.802080 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:23.802047    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:36.187634 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:36.187599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:46.997452 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:46.997420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:57:56.388067 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:57:56.388025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:04.087958 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:04.087920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:14.997271 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:14.997236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:24.889911 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:24.889821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:37.898374 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:37.898337    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:46.794270 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:46.794229    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:58:56.289676 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:58:56.289638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:59:06.188430 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:59:06.188391    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:59:17.098837 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:59:17.098807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:59:27.895775 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:59:27.895736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:59:40.394256 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:59:40.394215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 15 23:59:51.197000 ip-10-0-133-3 kubenswrapper[2578]: I0715 23:59:51.196920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:00:00.492137 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:00:00.492099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:00:15.088400 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:00:15.088363    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:00:28.789280 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:00:28.789240    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:00:51.984324 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:00:51.984286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:01:03.407183 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:01:03.407098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:01:12.793719 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:01:12.793681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:02:33.592362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:02:33.592333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:02:42.492225 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:02:42.492187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:02:55.801335 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:02:55.801251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:03:10.090164 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:03:10.090124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:03:32.186799 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:03:32.186763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:03:43.483127 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:03:43.483093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:04:31.992127 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:31.992087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:04:43.985414 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:43.985380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:04:48.795574 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.795539    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:04:48.799157 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.799140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.801747 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.801728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d3fd63\"/\"default-dockercfg-45nh4\""
Jul 16 00:04:48.803072 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.803039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d3fd63\"/\"openshift-service-ca.crt\""
Jul 16 00:04:48.803072 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.803057    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d3fd63\"/\"test-model-d3fd63-kserve-self-signed-certs\""
Jul 16 00:04:48.803239 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.803092    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d3fd63\"/\"kube-root-ca.crt\""
Jul 16 00:04:48.807176 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.807153    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:04:48.826111 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8xjt\" (UniqueName: \"kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.826268 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.826268 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.826381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.826381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.826381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.826328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927159 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8xjt\" (UniqueName: \"kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927667 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927628    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927729 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.927729 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.927716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.929602 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.929577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.929914 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.929895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:48.936266 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:48.936240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8xjt\" (UniqueName: \"kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt\") pod \"test-model-d3fd63-kserve-5dcc6bb88f-29bc9\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") " pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:49.108610 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:49.108523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:49.241335 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:49.241288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:04:49.244290 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:04:49.244263    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fae298f_de37_445d_b359_133c0766fb75.slice/crio-aef6d7ee68ffe337817922a60dc9d443de39b2b5e485579bc9b1210fe6d91e48 WatchSource:0}: Error finding container aef6d7ee68ffe337817922a60dc9d443de39b2b5e485579bc9b1210fe6d91e48: Status 404 returned error can't find the container with id aef6d7ee68ffe337817922a60dc9d443de39b2b5e485579bc9b1210fe6d91e48
Jul 16 00:04:49.638177 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:49.638147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" event={"ID":"2fae298f-de37-445d-b359-133c0766fb75","Type":"ContainerStarted","Data":"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"}
Jul 16 00:04:49.638374 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:49.638194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" event={"ID":"2fae298f-de37-445d-b359-133c0766fb75","Type":"ContainerStarted","Data":"aef6d7ee68ffe337817922a60dc9d443de39b2b5e485579bc9b1210fe6d91e48"}
Jul 16 00:04:49.655509 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:49.655452    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" podStartSLOduration=1.655435616 podStartE2EDuration="1.655435616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:04:49.653886527 +0000 UTC m=+1735.185715518" watchObservedRunningTime="2026-07-16 00:04:49.655435616 +0000 UTC m=+1735.187264581"
Jul 16 00:04:52.890040 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:52.890001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:04:59.109191 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:59.109152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:59.109614 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:59.109208    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:59.121641 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:59.121612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:04:59.696098 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:04:59.696069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:05:04.289207 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:04.289172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:05:19.592036 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.592005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:05:19.595499 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.595472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.599105 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.599082    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd8441\"/\"default-dockercfg-cpsfc\""
Jul 16 00:05:19.599255 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.599082    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd8441\"/\"test-model-dd8441-kserve-self-signed-certs\""
Jul 16 00:05:19.599255 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.599088    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd8441\"/\"openshift-service-ca.crt\""
Jul 16 00:05:19.599255 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.599153    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd8441\"/\"kube-root-ca.crt\""
Jul 16 00:05:19.605000 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.604978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:05:19.696705 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.696872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.696872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.696872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.696872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlmww\" (UniqueName: \"kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.697006 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.696899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.797731 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.797907 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.797907 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.797907 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.798057 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.798057 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.797996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlmww\" (UniqueName: \"kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.798156 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.798105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.798156 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.798131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.798264 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.798247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.799995 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.799967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.800351 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.800334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.805312 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.805292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlmww\" (UniqueName: \"kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww\") pod \"test-model-dd8441-kserve-5f56766b95-htlmg\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") " pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:19.906111 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:19.906027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:20.040231 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:20.040199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:05:20.044033 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:05:20.044006    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod774b7edc_0eaa_43c8_a52d_a0e04a797f6d.slice/crio-af7e77772bd1b28c3648077eb11d826c90bb693b53e4f2cd6905f995e9f03d93 WatchSource:0}: Error finding container af7e77772bd1b28c3648077eb11d826c90bb693b53e4f2cd6905f995e9f03d93: Status 404 returned error can't find the container with id af7e77772bd1b28c3648077eb11d826c90bb693b53e4f2cd6905f995e9f03d93
Jul 16 00:05:20.783370 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:20.783337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" event={"ID":"774b7edc-0eaa-43c8-a52d-a0e04a797f6d","Type":"ContainerStarted","Data":"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"}
Jul 16 00:05:20.783775 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:20.783381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" event={"ID":"774b7edc-0eaa-43c8-a52d-a0e04a797f6d","Type":"ContainerStarted","Data":"af7e77772bd1b28c3648077eb11d826c90bb693b53e4f2cd6905f995e9f03d93"}
Jul 16 00:05:20.800617 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:20.800571    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" podStartSLOduration=1.800555254 podStartE2EDuration="1.800555254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:05:20.798926111 +0000 UTC m=+1766.330755100" watchObservedRunningTime="2026-07-16 00:05:20.800555254 +0000 UTC m=+1766.332384242"
Jul 16 00:05:23.782781 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:23.782749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:05:29.906612 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:29.906569    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:29.906612 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:29.906622    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:29.919215 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:29.919190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:30.838788 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:30.838754    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:05:42.792868 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:42.792834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:05:49.414090 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:49.413999    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:05:50.309572 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:50.309543    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:05:57.082755 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:05:57.082723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:06:04.435715 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.435652    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" podUID="2fae298f-de37-445d-b359-133c0766fb75" containerName="main" containerID="cri-o://5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a" gracePeriod=45
Jul 16 00:06:04.694759 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.694698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:06:04.788592 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.788549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.788592 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.788596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.788824 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.788641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789074    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home" (OuterVolumeSpecName: "home") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8xjt\" (UniqueName: \"kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789242    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs\") pod \"2fae298f-de37-445d-b359-133c0766fb75\" (UID: \"2fae298f-de37-445d-b359-133c0766fb75\") "
Jul 16 00:06:04.791430 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.789328    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:04.792039 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.792018    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-home\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.792109 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.792047    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-model-cache\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.792109 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.792061    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-tmp-dir\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.796852 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.796824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm" (OuterVolumeSpecName: "dshm") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:04.796969 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.796851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt" (OuterVolumeSpecName: "kube-api-access-f8xjt") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "kube-api-access-f8xjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:06:04.796969 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.796865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fae298f-de37-445d-b359-133c0766fb75" (UID: "2fae298f-de37-445d-b359-133c0766fb75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:06:04.892879 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.892842    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fae298f-de37-445d-b359-133c0766fb75-tls-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.892879 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.892873    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fae298f-de37-445d-b359-133c0766fb75-dshm\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.892879 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.892883    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8xjt\" (UniqueName: \"kubernetes.io/projected/2fae298f-de37-445d-b359-133c0766fb75-kube-api-access-f8xjt\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:04.988239 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.988149    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fae298f-de37-445d-b359-133c0766fb75" containerID="5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a" exitCode=0
Jul 16 00:06:04.988239 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.988202    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"
Jul 16 00:06:04.988414 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.988242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" event={"ID":"2fae298f-de37-445d-b359-133c0766fb75","Type":"ContainerDied","Data":"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"}
Jul 16 00:06:04.988414 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.988291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9" event={"ID":"2fae298f-de37-445d-b359-133c0766fb75","Type":"ContainerDied","Data":"aef6d7ee68ffe337817922a60dc9d443de39b2b5e485579bc9b1210fe6d91e48"}
Jul 16 00:06:04.988414 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.988308    2578 scope.go:117] "RemoveContainer" containerID="5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"
Jul 16 00:06:04.997886 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.997867    2578 scope.go:117] "RemoveContainer" containerID="5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"
Jul 16 00:06:04.998158 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:06:04.998131    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a\": container with ID starting with 5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a not found: ID does not exist" containerID="5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"
Jul 16 00:06:04.998249 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:04.998174    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a"} err="failed to get container status \"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a\": rpc error: code = NotFound desc = could not find container \"5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a\": container with ID starting with 5e4d59c448a860108e282e9a698b2db335f64f929690cc08549e8552298cb10a not found: ID does not exist"
Jul 16 00:06:05.008851 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.008827    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:06:05.012349 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.012327    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d3fd63/test-model-d3fd63-kserve-5dcc6bb88f-29bc9"]
Jul 16 00:06:05.335727 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.335688    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" podUID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" containerName="main" containerID="cri-o://bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a" gracePeriod=45
Jul 16 00:06:05.590148 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.590082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:06:05.700220 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700183    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700220 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700460 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700251    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700460 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700460 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700460 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlmww\" (UniqueName: \"kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww\") pod \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\" (UID: \"774b7edc-0eaa-43c8-a52d-a0e04a797f6d\") "
Jul 16 00:06:05.700690 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home" (OuterVolumeSpecName: "home") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:05.700690 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:05.700690 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700659    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-home\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.700964 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.700935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:05.702540 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.702511    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm" (OuterVolumeSpecName: "dshm") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:05.702540 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.702513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:06:05.702673 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.702576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww" (OuterVolumeSpecName: "kube-api-access-wlmww") pod "774b7edc-0eaa-43c8-a52d-a0e04a797f6d" (UID: "774b7edc-0eaa-43c8-a52d-a0e04a797f6d"). InnerVolumeSpecName "kube-api-access-wlmww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:06:05.801308 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.801271    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-dshm\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.801308 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.801298    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tmp-dir\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.801308 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.801309    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlmww\" (UniqueName: \"kubernetes.io/projected/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-kube-api-access-wlmww\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.801308 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.801317    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-tls-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.801611 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.801326    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774b7edc-0eaa-43c8-a52d-a0e04a797f6d-model-cache\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:06:05.995639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.995555    2578 generic.go:356] "Generic (PLEG): container finished" podID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" containerID="bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a" exitCode=0
Jul 16 00:06:05.995639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.995593    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"
Jul 16 00:06:05.995639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.995599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" event={"ID":"774b7edc-0eaa-43c8-a52d-a0e04a797f6d","Type":"ContainerDied","Data":"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"}
Jul 16 00:06:05.995639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.995623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg" event={"ID":"774b7edc-0eaa-43c8-a52d-a0e04a797f6d","Type":"ContainerDied","Data":"af7e77772bd1b28c3648077eb11d826c90bb693b53e4f2cd6905f995e9f03d93"}
Jul 16 00:06:05.995639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:05.995639    2578 scope.go:117] "RemoveContainer" containerID="bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"
Jul 16 00:06:06.008174 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.008156    2578 scope.go:117] "RemoveContainer" containerID="bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"
Jul 16 00:06:06.008443 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:06:06.008427    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a\": container with ID starting with bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a not found: ID does not exist" containerID="bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"
Jul 16 00:06:06.008526 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.008451    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a"} err="failed to get container status \"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a\": rpc error: code = NotFound desc = could not find container \"bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a\": container with ID starting with bd1a1555016f412848342535c15ef54858661add4cecf0f4bf6e82258b993e3a not found: ID does not exist"
Jul 16 00:06:06.018535 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.018512    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:06:06.022877 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.022856    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dd8441/test-model-dd8441-kserve-5f56766b95-htlmg"]
Jul 16 00:06:06.996602 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.996565    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fae298f-de37-445d-b359-133c0766fb75" path="/var/lib/kubelet/pods/2fae298f-de37-445d-b359-133c0766fb75/volumes"
Jul 16 00:06:06.997009 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:06.996993    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" path="/var/lib/kubelet/pods/774b7edc-0eaa-43c8-a52d-a0e04a797f6d/volumes"
Jul 16 00:06:36.585680 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:36.585647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:06:47.889829 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:47.889792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:06:51.092408 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092375    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"]
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092728    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" containerName="main"
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092739    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" containerName="main"
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092763    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fae298f-de37-445d-b359-133c0766fb75" containerName="main"
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092769    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fae298f-de37-445d-b359-133c0766fb75" containerName="main"
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092839    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="774b7edc-0eaa-43c8-a52d-a0e04a797f6d" containerName="main"
Jul 16 00:06:51.092900 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.092848    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fae298f-de37-445d-b359-133c0766fb75" containerName="main"
Jul 16 00:06:51.100929 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.100904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.103952 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.103924    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 00:06:51.104171 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.104152    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 00:06:51.104366 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.104349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-eae7a4-serving-cert\""
Jul 16 00:06:51.104852 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.104825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"]
Jul 16 00:06:51.104964 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.104833    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n27d6\""
Jul 16 00:06:51.184939 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.184907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.185120 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.184947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx65b\" (UniqueName: \"kubernetes.io/projected/45567c4b-b6ec-44b8-8598-d829b1cbb125-kube-api-access-jx65b\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.185120 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.185009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45567c4b-b6ec-44b8-8598-d829b1cbb125-openshift-service-ca\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.285754 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.285716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.285754 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.285756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx65b\" (UniqueName: \"kubernetes.io/projected/45567c4b-b6ec-44b8-8598-d829b1cbb125-kube-api-access-jx65b\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.286020 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.285777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45567c4b-b6ec-44b8-8598-d829b1cbb125-openshift-service-ca\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.286020 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:06:51.285886    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-serving-cert: secret "maas-api-e2e-api-b-eae7a4-serving-cert" not found
Jul 16 00:06:51.286020 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:06:51.285963    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls podName:45567c4b-b6ec-44b8-8598-d829b1cbb125 nodeName:}" failed. No retries permitted until 2026-07-16 00:06:51.785941118 +0000 UTC m=+1857.317770094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls") pod "maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw" (UID: "45567c4b-b6ec-44b8-8598-d829b1cbb125") : secret "maas-api-e2e-api-b-eae7a4-serving-cert" not found
Jul 16 00:06:51.286368 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.286350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45567c4b-b6ec-44b8-8598-d829b1cbb125-openshift-service-ca\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.304065 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.304029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx65b\" (UniqueName: \"kubernetes.io/projected/45567c4b-b6ec-44b8-8598-d829b1cbb125-kube-api-access-jx65b\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.791287 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.791249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:51.793689 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:51.793666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45567c4b-b6ec-44b8-8598-d829b1cbb125-maas-api-tls\") pod \"maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw\" (UID: \"45567c4b-b6ec-44b8-8598-d829b1cbb125\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:52.013505 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:52.013454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:52.152039 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:52.152010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"]
Jul 16 00:06:52.155091 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:06:52.155064    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45567c4b_b6ec_44b8_8598_d829b1cbb125.slice/crio-e868008b3f78bbaded45eff97254f3de9f3ed803125ee1eb456940c6b32da960 WatchSource:0}: Error finding container e868008b3f78bbaded45eff97254f3de9f3ed803125ee1eb456940c6b32da960: Status 404 returned error can't find the container with id e868008b3f78bbaded45eff97254f3de9f3ed803125ee1eb456940c6b32da960
Jul 16 00:06:52.156816 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:52.156796    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:06:52.202110 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:52.202075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw" event={"ID":"45567c4b-b6ec-44b8-8598-d829b1cbb125","Type":"ContainerStarted","Data":"e868008b3f78bbaded45eff97254f3de9f3ed803125ee1eb456940c6b32da960"}
Jul 16 00:06:55.221113 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:55.221072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw" event={"ID":"45567c4b-b6ec-44b8-8598-d829b1cbb125","Type":"ContainerStarted","Data":"5b1ea47d97486edd86ec747c8fd68e0c7b117fb82ad8376af31db666abe5fd75"}
Jul 16 00:06:55.221540 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:55.221210    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:06:55.237898 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:06:55.237852    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw" podStartSLOduration=1.978336302 podStartE2EDuration="4.237835317s" totalImagesPullingTime="2.259499015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:06:55.236607467 +0000 UTC m=+1860.768436456" watchObservedRunningTime="2026-07-16 00:06:55.237835317 +0000 UTC m=+1860.769664304"
Jul 16 00:07:01.231175 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:01.231144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw"
Jul 16 00:07:02.692731 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:02.692696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:07:20.688401 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:20.688324    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:07:32.279328 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.279291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"]
Jul 16 00:07:32.286574 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.286547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.289075 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.289046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-ef3a1a-serving-cert\""
Jul 16 00:07:32.295310 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.295287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"]
Jul 16 00:07:32.335388 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.335346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23fff65-fe30-4102-a147-2f01dbd31750-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.335568 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.335415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28p8x\" (UniqueName: \"kubernetes.io/projected/a23fff65-fe30-4102-a147-2f01dbd31750-kube-api-access-28p8x\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.335568 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.335469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.436575 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.436546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23fff65-fe30-4102-a147-2f01dbd31750-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.436771 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.436589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28p8x\" (UniqueName: \"kubernetes.io/projected/a23fff65-fe30-4102-a147-2f01dbd31750-kube-api-access-28p8x\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.436771 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.436647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.436771 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:07:32.436758    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-serving-cert: secret "maas-api-e2e-shared-a-ef3a1a-serving-cert" not found
Jul 16 00:07:32.436953 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:07:32.436832    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls podName:a23fff65-fe30-4102-a147-2f01dbd31750 nodeName:}" failed. No retries permitted until 2026-07-16 00:07:32.936809045 +0000 UTC m=+1898.468638010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls") pod "maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx" (UID: "a23fff65-fe30-4102-a147-2f01dbd31750") : secret "maas-api-e2e-shared-a-ef3a1a-serving-cert" not found
Jul 16 00:07:32.437254 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.437231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23fff65-fe30-4102-a147-2f01dbd31750-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.453743 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.453714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28p8x\" (UniqueName: \"kubernetes.io/projected/a23fff65-fe30-4102-a147-2f01dbd31750-kube-api-access-28p8x\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.940885 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.940843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:32.943392 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:32.943360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23fff65-fe30-4102-a147-2f01dbd31750-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx\" (UID: \"a23fff65-fe30-4102-a147-2f01dbd31750\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:33.198424 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:33.198342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:33.339167 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:33.339135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"]
Jul 16 00:07:33.346168 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:07:33.346140    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23fff65_fe30_4102_a147_2f01dbd31750.slice/crio-18f6aa3017fbe5ac777a63687119f9d6f54fdac64d91372455a03cf70afc933f WatchSource:0}: Error finding container 18f6aa3017fbe5ac777a63687119f9d6f54fdac64d91372455a03cf70afc933f: Status 404 returned error can't find the container with id 18f6aa3017fbe5ac777a63687119f9d6f54fdac64d91372455a03cf70afc933f
Jul 16 00:07:33.392094 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:33.392055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx" event={"ID":"a23fff65-fe30-4102-a147-2f01dbd31750","Type":"ContainerStarted","Data":"18f6aa3017fbe5ac777a63687119f9d6f54fdac64d91372455a03cf70afc933f"}
Jul 16 00:07:35.403345 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:35.403308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx" event={"ID":"a23fff65-fe30-4102-a147-2f01dbd31750","Type":"ContainerStarted","Data":"3f0d4a9054ca60e7860de52dd7cf2ca9671a1b3ad62d7d829c6420e260927688"}
Jul 16 00:07:35.403833 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:35.403549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:35.419700 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:35.419656    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx" podStartSLOduration=1.899005734 podStartE2EDuration="3.419641491s" totalImagesPullingTime="1.520635757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:07:35.417917335 +0000 UTC m=+1900.949746322" watchObservedRunningTime="2026-07-16 00:07:35.419641491 +0000 UTC m=+1900.951470480"
Jul 16 00:07:35.986550 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:35.986514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:07:40.384093 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.384061    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"]
Jul 16 00:07:40.387870 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.387847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.390949 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.390924    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e94b3e-serving-cert\""
Jul 16 00:07:40.406024 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.406002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.406132 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.406046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c2879c-a614-4bcb-a30e-45a3ef477d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.406132 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.406120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jwjc\" (UniqueName: \"kubernetes.io/projected/12c2879c-a614-4bcb-a30e-45a3ef477d2d-kube-api-access-8jwjc\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.422972 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.422945    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"]
Jul 16 00:07:40.507567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.507530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.507736 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.507585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c2879c-a614-4bcb-a30e-45a3ef477d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.507736 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.507654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jwjc\" (UniqueName: \"kubernetes.io/projected/12c2879c-a614-4bcb-a30e-45a3ef477d2d-kube-api-access-8jwjc\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.507736 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:07:40.507715    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-serving-cert: secret "maas-api-e2e-shared-b-e94b3e-serving-cert" not found
Jul 16 00:07:40.507852 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:07:40.507794    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls podName:12c2879c-a614-4bcb-a30e-45a3ef477d2d nodeName:}" failed. No retries permitted until 2026-07-16 00:07:41.007771931 +0000 UTC m=+1906.539600896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls") pod "maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826" (UID: "12c2879c-a614-4bcb-a30e-45a3ef477d2d") : secret "maas-api-e2e-shared-b-e94b3e-serving-cert" not found
Jul 16 00:07:40.508233 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.508212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c2879c-a614-4bcb-a30e-45a3ef477d2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:40.516174 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:40.516149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jwjc\" (UniqueName: \"kubernetes.io/projected/12c2879c-a614-4bcb-a30e-45a3ef477d2d-kube-api-access-8jwjc\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:41.013662 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:41.013621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:41.015972 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:41.015951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c2879c-a614-4bcb-a30e-45a3ef477d2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826\" (UID: \"12c2879c-a614-4bcb-a30e-45a3ef477d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:41.299031 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:41.298930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:41.415181 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:41.415156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx"
Jul 16 00:07:41.448463 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:41.448424    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"]
Jul 16 00:07:41.458172 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:07:41.458139    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c2879c_a614_4bcb_a30e_45a3ef477d2d.slice/crio-7355bd4d6ad5db582278e01131acd20737f60b285e5007f315a31ccaa0f33ee0 WatchSource:0}: Error finding container 7355bd4d6ad5db582278e01131acd20737f60b285e5007f315a31ccaa0f33ee0: Status 404 returned error can't find the container with id 7355bd4d6ad5db582278e01131acd20737f60b285e5007f315a31ccaa0f33ee0
Jul 16 00:07:42.443218 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:42.443180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826" event={"ID":"12c2879c-a614-4bcb-a30e-45a3ef477d2d","Type":"ContainerStarted","Data":"d6e35f4e42efe37a0798dc3e5a9c6b6e20561cbf430092940233ca17bd33921f"}
Jul 16 00:07:42.443617 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:42.443244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826" event={"ID":"12c2879c-a614-4bcb-a30e-45a3ef477d2d","Type":"ContainerStarted","Data":"7355bd4d6ad5db582278e01131acd20737f60b285e5007f315a31ccaa0f33ee0"}
Jul 16 00:07:42.443617 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:42.443282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:42.461757 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:42.461713    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826" podStartSLOduration=2.009291578 podStartE2EDuration="2.461698402s" totalImagesPullingTime="452.406824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:07:42.461596996 +0000 UTC m=+1907.993425986" watchObservedRunningTime="2026-07-16 00:07:42.461698402 +0000 UTC m=+1907.993527389"
Jul 16 00:07:48.453125 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:48.453095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826"
Jul 16 00:07:53.186924 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:53.186891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:07:58.898767 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.898727    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:07:58.902805 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.902785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.906241 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.906215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"openshift-service-ca.crt\""
Jul 16 00:07:58.906381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.906252    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"default-dockercfg-wcswv\""
Jul 16 00:07:58.906381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.906284    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"auth-test-model-ef3a1a-kserve-self-signed-certs\""
Jul 16 00:07:58.906381 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.906253    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"kube-root-ca.crt\""
Jul 16 00:07:58.911238 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.911215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:07:58.976072 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.976247 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7tb9\" (UniqueName: \"kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.976247 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.976247 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.976360 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:58.976360 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:58.976301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.076787 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.076745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.076787 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.076793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077104 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.076923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077104 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077104 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7tb9\" (UniqueName: \"kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077259 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077259 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077259 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.077486 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.077467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.079178 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.079161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.079563 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.079544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.085001 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.084978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7tb9\" (UniqueName: \"kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9\") pod \"auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") " pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.213534 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.213441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:07:59.366995 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.366967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:07:59.368820 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:07:59.368794    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb03e371_7c2f_4e2c_b725_516fadddf87a.slice/crio-9063bee4973dcfd58e5413d3847e8c997473ec74e9436a67f0ed67274a354ecd WatchSource:0}: Error finding container 9063bee4973dcfd58e5413d3847e8c997473ec74e9436a67f0ed67274a354ecd: Status 404 returned error can't find the container with id 9063bee4973dcfd58e5413d3847e8c997473ec74e9436a67f0ed67274a354ecd
Jul 16 00:07:59.521080 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.521044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" event={"ID":"bb03e371-7c2f-4e2c-b725-516fadddf87a","Type":"ContainerStarted","Data":"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"}
Jul 16 00:07:59.521249 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.521091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" event={"ID":"bb03e371-7c2f-4e2c-b725-516fadddf87a","Type":"ContainerStarted","Data":"9063bee4973dcfd58e5413d3847e8c997473ec74e9436a67f0ed67274a354ecd"}
Jul 16 00:07:59.539291 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:07:59.539233    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" podStartSLOduration=1.53921537 podStartE2EDuration="1.53921537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:07:59.538105483 +0000 UTC m=+1925.069934471" watchObservedRunningTime="2026-07-16 00:07:59.53921537 +0000 UTC m=+1925.071044357"
Jul 16 00:08:02.088946 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:02.088912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:08:09.213652 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:09.213618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:08:09.214031 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:09.213700    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:08:09.226269 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:09.226238    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:08:09.577387 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:09.577355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:08:39.483385 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:39.483346    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:08:54.294595 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:08:54.294518    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:09:13.893566 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:09:13.893529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:09:34.690233 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:09:34.690197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:09:54.084425 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:09:54.084387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:10:13.693868 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:10:13.693833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:10:33.485053 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:10:33.485017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:10:53.787653 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:10:53.787617    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:10:59.492370 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:10:59.492336    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:11:13.791432 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:13.791397    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:11:14.513338 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.513291    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" podUID="bb03e371-7c2f-4e2c-b725-516fadddf87a" containerName="main" containerID="cri-o://dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc" gracePeriod=45
Jul 16 00:11:14.781872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.781848    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:11:14.883228 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883235    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7tb9\" (UniqueName: \"kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883388    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache\") pod \"bb03e371-7c2f-4e2c-b725-516fadddf87a\" (UID: \"bb03e371-7c2f-4e2c-b725-516fadddf87a\") "
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883584    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:11:14.883671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home" (OuterVolumeSpecName: "home") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:11:14.883941 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.883714    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:11:14.885629 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.885607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm" (OuterVolumeSpecName: "dshm") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:11:14.885720 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.885668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9" (OuterVolumeSpecName: "kube-api-access-t7tb9") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "kube-api-access-t7tb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:11:14.885759 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.885727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb03e371-7c2f-4e2c-b725-516fadddf87a" (UID: "bb03e371-7c2f-4e2c-b725-516fadddf87a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:11:14.984292 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984246    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-tmp-dir\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:14.984292 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984284    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-home\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:14.984292 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984295    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-dshm\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:14.984567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984308    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7tb9\" (UniqueName: \"kubernetes.io/projected/bb03e371-7c2f-4e2c-b725-516fadddf87a-kube-api-access-t7tb9\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:14.984567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984322    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb03e371-7c2f-4e2c-b725-516fadddf87a-model-cache\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:14.984567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:14.984334    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb03e371-7c2f-4e2c-b725-516fadddf87a-tls-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:11:15.433455 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.433422    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb03e371-7c2f-4e2c-b725-516fadddf87a" containerID="dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc" exitCode=0
Jul 16 00:11:15.433455 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.433457    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"
Jul 16 00:11:15.433733 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.433522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" event={"ID":"bb03e371-7c2f-4e2c-b725-516fadddf87a","Type":"ContainerDied","Data":"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"}
Jul 16 00:11:15.433733 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.433569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx" event={"ID":"bb03e371-7c2f-4e2c-b725-516fadddf87a","Type":"ContainerDied","Data":"9063bee4973dcfd58e5413d3847e8c997473ec74e9436a67f0ed67274a354ecd"}
Jul 16 00:11:15.433733 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.433592    2578 scope.go:117] "RemoveContainer" containerID="dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"
Jul 16 00:11:15.442284 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.442261    2578 scope.go:117] "RemoveContainer" containerID="dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"
Jul 16 00:11:15.442557 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:11:15.442537    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc\": container with ID starting with dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc not found: ID does not exist" containerID="dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"
Jul 16 00:11:15.442646 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.442564    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc"} err="failed to get container status \"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc\": rpc error: code = NotFound desc = could not find container \"dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc\": container with ID starting with dce58296bcd2e41b42d9026e390142804d21c372cdee98f372bb59502ca192fc not found: ID does not exist"
Jul 16 00:11:15.449437 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.449413    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:11:15.453437 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:15.453418    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/auth-test-model-ef3a1a-kserve-8545bcfd75-x6qqx"]
Jul 16 00:11:16.996737 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:16.996707    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb03e371-7c2f-4e2c-b725-516fadddf87a" path="/var/lib/kubelet/pods/bb03e371-7c2f-4e2c-b725-516fadddf87a/volumes"
Jul 16 00:11:23.893832 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.893797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:11:23.894204 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.894145    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb03e371-7c2f-4e2c-b725-516fadddf87a" containerName="main"
Jul 16 00:11:23.894204 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.894155    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb03e371-7c2f-4e2c-b725-516fadddf87a" containerName="main"
Jul 16 00:11:23.894275 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.894228    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb03e371-7c2f-4e2c-b725-516fadddf87a" containerName="main"
Jul 16 00:11:23.898345 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.898330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.901872 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.901845    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"sub-test-model-ef3a1a-kserve-self-signed-certs\""
Jul 16 00:11:23.902054 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.901890    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"kube-root-ca.crt\""
Jul 16 00:11:23.902054 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.901854    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"openshift-service-ca.crt\""
Jul 16 00:11:23.902054 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.901916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"default-dockercfg-wcswv\""
Jul 16 00:11:23.906597 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.906566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:11:23.959852 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.959810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.960048 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.959863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.960048 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.959940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.960048 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.960025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.960202 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.960055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:23.960202 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:23.960084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4d6\" (UniqueName: \"kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061296 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061472 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061472 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061472 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4d6\" (UniqueName: \"kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061472 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061472 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061827 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061911 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.061911 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.061890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.063506 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.063473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.063762 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.063745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.068449 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.068427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4d6\" (UniqueName: \"kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6\") pod \"sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") " pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.208402 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.208313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:24.349717 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.349689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:11:24.351760 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:11:24.351733    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod452b4101_2548_4104_abb0_7ac0f2a47bb7.slice/crio-37ba0504dc0189718a4f5f03a8949cb3768c6989d504b5bb260738875bd961c3 WatchSource:0}: Error finding container 37ba0504dc0189718a4f5f03a8949cb3768c6989d504b5bb260738875bd961c3: Status 404 returned error can't find the container with id 37ba0504dc0189718a4f5f03a8949cb3768c6989d504b5bb260738875bd961c3
Jul 16 00:11:24.477884 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.477795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" event={"ID":"452b4101-2548-4104-abb0-7ac0f2a47bb7","Type":"ContainerStarted","Data":"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"}
Jul 16 00:11:24.477884 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.477842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" event={"ID":"452b4101-2548-4104-abb0-7ac0f2a47bb7","Type":"ContainerStarted","Data":"37ba0504dc0189718a4f5f03a8949cb3768c6989d504b5bb260738875bd961c3"}
Jul 16 00:11:24.494480 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:24.494427    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" podStartSLOduration=1.49441141 podStartE2EDuration="1.49441141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:11:24.492891324 +0000 UTC m=+2130.024720311" watchObservedRunningTime="2026-07-16 00:11:24.49441141 +0000 UTC m=+2130.026240398"
Jul 16 00:11:31.496506 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:31.496469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:11:34.209148 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:34.209112    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:34.209148 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:34.209159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:34.221552 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:34.221529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:11:34.540942 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:11:34.540912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:12:02.591112 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:02.591075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:12:23.040530 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:23.040478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:12:39.094025 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:39.093991    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:12:45.983267 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:45.983231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:12:54.116247 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.116206    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" podUID="452b4101-2548-4104-abb0-7ac0f2a47bb7" containerName="main" containerID="cri-o://310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8" gracePeriod=45
Jul 16 00:12:54.167217 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:12:54.167186    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod452b4101_2548_4104_abb0_7ac0f2a47bb7.slice/crio-conmon-310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 00:12:54.386857 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.386834    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:12:54.468971 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.468938    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.468971 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.468973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.469219 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.468995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj4d6\" (UniqueName: \"kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.469219 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.469219 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.469219 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm\") pod \"452b4101-2548-4104-abb0-7ac0f2a47bb7\" (UID: \"452b4101-2548-4104-abb0-7ac0f2a47bb7\") "
Jul 16 00:12:54.469448 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469221    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:12:54.469448 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home" (OuterVolumeSpecName: "home") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:12:54.469448 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache" (OuterVolumeSpecName: "model-cache") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:12:54.469635 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469479    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-tmp-dir\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.469635 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469517    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-home\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.469635 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.469532    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-model-cache\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.471105 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.471084    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm" (OuterVolumeSpecName: "dshm") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:12:54.471207 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.471121    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6" (OuterVolumeSpecName: "kube-api-access-sj4d6") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "kube-api-access-sj4d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:12:54.471207 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.471183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "452b4101-2548-4104-abb0-7ac0f2a47bb7" (UID: "452b4101-2548-4104-abb0-7ac0f2a47bb7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:12:54.570031 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.570000    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452b4101-2548-4104-abb0-7ac0f2a47bb7-tls-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.570031 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.570029    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj4d6\" (UniqueName: \"kubernetes.io/projected/452b4101-2548-4104-abb0-7ac0f2a47bb7-kube-api-access-sj4d6\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.570254 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.570042    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/452b4101-2548-4104-abb0-7ac0f2a47bb7-dshm\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:12:54.907260 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.907220    2578 generic.go:356] "Generic (PLEG): container finished" podID="452b4101-2548-4104-abb0-7ac0f2a47bb7" containerID="310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8" exitCode=0
Jul 16 00:12:54.907260 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.907264    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"
Jul 16 00:12:54.907260 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.907268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" event={"ID":"452b4101-2548-4104-abb0-7ac0f2a47bb7","Type":"ContainerDied","Data":"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"}
Jul 16 00:12:54.907567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.907305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b" event={"ID":"452b4101-2548-4104-abb0-7ac0f2a47bb7","Type":"ContainerDied","Data":"37ba0504dc0189718a4f5f03a8949cb3768c6989d504b5bb260738875bd961c3"}
Jul 16 00:12:54.907567 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.907326    2578 scope.go:117] "RemoveContainer" containerID="310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"
Jul 16 00:12:54.916361 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.916343    2578 scope.go:117] "RemoveContainer" containerID="310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"
Jul 16 00:12:54.916632 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:12:54.916615    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8\": container with ID starting with 310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8 not found: ID does not exist" containerID="310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"
Jul 16 00:12:54.916680 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.916638    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8"} err="failed to get container status \"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8\": rpc error: code = NotFound desc = could not find container \"310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8\": container with ID starting with 310bed73e9a8e55b35c803264623393959b9bf415433733730fadfbed2d6e9f8 not found: ID does not exist"
Jul 16 00:12:54.927639 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.927615    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:12:54.934520 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.932422    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/sub-test-model-ef3a1a-kserve-8b9679b7c-nzb9b"]
Jul 16 00:12:54.997327 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:12:54.997298    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452b4101-2548-4104-abb0-7ac0f2a47bb7" path="/var/lib/kubelet/pods/452b4101-2548-4104-abb0-7ac0f2a47bb7/volumes"
Jul 16 00:13:08.294271 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.294235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:13:08.294685 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.294670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452b4101-2548-4104-abb0-7ac0f2a47bb7" containerName="main"
Jul 16 00:13:08.294751 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.294687    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="452b4101-2548-4104-abb0-7ac0f2a47bb7" containerName="main"
Jul 16 00:13:08.294843 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.294821    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="452b4101-2548-4104-abb0-7ac0f2a47bb7" containerName="main"
Jul 16 00:13:08.297935 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.297917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.300717 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.300694    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"openshift-service-ca.crt\""
Jul 16 00:13:08.301547 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.301531    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"kube-root-ca.crt\""
Jul 16 00:13:08.301665 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.301572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"default-dockercfg-wcswv\""
Jul 16 00:13:08.301665 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.301588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef3a1a\"/\"rate-test-model-ef3a1a-kserve-self-signed-certs\""
Jul 16 00:13:08.310256 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.310234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:13:08.392219 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n88nh\" (UniqueName: \"kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.392426 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.392426 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.392580 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.392580 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.392580 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.392538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493650 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n88nh\" (UniqueName: \"kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493826 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493826 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493826 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493826 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.493826 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.493765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.494226 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.494195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.494338 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.494269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.494338 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.494321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.496230 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.496204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.496447 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.496429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.502010 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.501980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n88nh\" (UniqueName: \"kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh\") pod \"rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") " pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.607407 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.607315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:08.746083 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.746053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:13:08.747551 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:13:08.747524    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf5cd8f6_83ff_48f3_8c5a_8fdaa5322904.slice/crio-6e70b0305bd38843e3169a04e73562c6bfff8e7cf92b06f242e08e69c9fbfb22 WatchSource:0}: Error finding container 6e70b0305bd38843e3169a04e73562c6bfff8e7cf92b06f242e08e69c9fbfb22: Status 404 returned error can't find the container with id 6e70b0305bd38843e3169a04e73562c6bfff8e7cf92b06f242e08e69c9fbfb22
Jul 16 00:13:08.970156 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.970070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" event={"ID":"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904","Type":"ContainerStarted","Data":"23522be8bf343ee6834e74758301f3ca41072a19e21dca6e7bff8bac1f57eb15"}
Jul 16 00:13:08.970156 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.970111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" event={"ID":"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904","Type":"ContainerStarted","Data":"6e70b0305bd38843e3169a04e73562c6bfff8e7cf92b06f242e08e69c9fbfb22"}
Jul 16 00:13:08.986613 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:08.986560    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" podStartSLOduration=0.986544986 podStartE2EDuration="986.544986ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:08.986353977 +0000 UTC m=+2234.518182965" watchObservedRunningTime="2026-07-16 00:13:08.986544986 +0000 UTC m=+2234.518373975"
Jul 16 00:13:12.584014 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:12.583979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:13:18.608026 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:18.607965    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:18.608026 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:18.608032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:18.620856 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:18.620828    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:19.025938 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:19.025907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:13:39.788955 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:13:39.788920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:14:07.982965 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:07.982933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:14:27.895940 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:27.895904    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:14:33.210987 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:33.210947    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:14:35.058364 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.058321    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-140237447235504"]
Jul 16 00:14:35.061781 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.061756    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:35.064528 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.064463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6557m\""
Jul 16 00:14:35.066792 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.066770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237447235504"]
Jul 16 00:14:35.137896 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.137857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhr8s\" (UniqueName: \"kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s\") pod \"test-curl-7742-140237447235504\" (UID: \"4071942e-568d-4001-bb63-2d34de5ce512\") " pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:35.238408 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.238371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhr8s\" (UniqueName: \"kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s\") pod \"test-curl-7742-140237447235504\" (UID: \"4071942e-568d-4001-bb63-2d34de5ce512\") " pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:35.249658 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.249629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhr8s\" (UniqueName: \"kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s\") pod \"test-curl-7742-140237447235504\" (UID: \"4071942e-568d-4001-bb63-2d34de5ce512\") " pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:35.371229 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.371139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:35.504804 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.504777    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237447235504"]
Jul 16 00:14:35.507550 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:14:35.507524    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4071942e_568d_4001_bb63_2d34de5ce512.slice/crio-f8d5913de4155c9db8217b18ec5eeada9d2c4bd09ab95ffee9e73c2afc156ff3 WatchSource:0}: Error finding container f8d5913de4155c9db8217b18ec5eeada9d2c4bd09ab95ffee9e73c2afc156ff3: Status 404 returned error can't find the container with id f8d5913de4155c9db8217b18ec5eeada9d2c4bd09ab95ffee9e73c2afc156ff3
Jul 16 00:14:35.509375 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:35.509354    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:14:36.376796 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:36.376763    2578 generic.go:356] "Generic (PLEG): container finished" podID="4071942e-568d-4001-bb63-2d34de5ce512" containerID="a834dd3caaaf6e16387f198084259e09f33c9d587f3579e857195b5b400fcfcf" exitCode=0
Jul 16 00:14:36.377149 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:36.376850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237447235504" event={"ID":"4071942e-568d-4001-bb63-2d34de5ce512","Type":"ContainerDied","Data":"a834dd3caaaf6e16387f198084259e09f33c9d587f3579e857195b5b400fcfcf"}
Jul 16 00:14:36.377149 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:36.376890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237447235504" event={"ID":"4071942e-568d-4001-bb63-2d34de5ce512","Type":"ContainerStarted","Data":"f8d5913de4155c9db8217b18ec5eeada9d2c4bd09ab95ffee9e73c2afc156ff3"}
Jul 16 00:14:37.528451 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.528425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:37.558698 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.558672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhr8s\" (UniqueName: \"kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s\") pod \"4071942e-568d-4001-bb63-2d34de5ce512\" (UID: \"4071942e-568d-4001-bb63-2d34de5ce512\") "
Jul 16 00:14:37.560987 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.560962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s" (OuterVolumeSpecName: "kube-api-access-xhr8s") pod "4071942e-568d-4001-bb63-2d34de5ce512" (UID: "4071942e-568d-4001-bb63-2d34de5ce512"). InnerVolumeSpecName "kube-api-access-xhr8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:14:37.564368 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.564340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-140237447235504_4071942e-568d-4001-bb63-2d34de5ce512/test-curl-7742-140237447235504/0.log"
Jul 16 00:14:37.587313 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.587287    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-140237447235504"]
Jul 16 00:14:37.592106 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.592071    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-140237447235504"]
Jul 16 00:14:37.659738 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:37.659651    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhr8s\" (UniqueName: \"kubernetes.io/projected/4071942e-568d-4001-bb63-2d34de5ce512-kube-api-access-xhr8s\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:38.387270 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:38.387245    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:38.387509 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:38.387253    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8d5913de4155c9db8217b18ec5eeada9d2c4bd09ab95ffee9e73c2afc156ff3"
Jul 16 00:14:38.397350 ip-10-0-133-3 kubenswrapper[2578]: E0716 00:14:38.397321    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7742-140237447235504\" is forbidden: User \"system:node:ip-10-0-133-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-3.ec2.internal' and this object" podUID="4071942e-568d-4001-bb63-2d34de5ce512" pod="opendatahub/test-curl-7742-140237447235504"
Jul 16 00:14:38.996046 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:38.996013    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4071942e-568d-4001-bb63-2d34de5ce512" path="/var/lib/kubelet/pods/4071942e-568d-4001-bb63-2d34de5ce512/volumes"
Jul 16 00:14:40.927577 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.927543    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:40.927962 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.927927    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4071942e-568d-4001-bb63-2d34de5ce512" containerName="test-curl-7742-140237447235504"
Jul 16 00:14:40.927962 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.927938    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4071942e-568d-4001-bb63-2d34de5ce512" containerName="test-curl-7742-140237447235504"
Jul 16 00:14:40.928045 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.928001    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4071942e-568d-4001-bb63-2d34de5ce512" containerName="test-curl-7742-140237447235504"
Jul 16 00:14:40.931060 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.931045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:40.933643 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.933621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6557m\""
Jul 16 00:14:40.937059 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.937031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:40.990794 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:40.990746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bd62\" (UniqueName: \"kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62\") pod \"test-curl-7742-140237449325856\" (UID: \"d85bff45-4727-4a5e-be02-404fd7a56d0e\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:41.091824 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:41.091786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bd62\" (UniqueName: \"kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62\") pod \"test-curl-7742-140237449325856\" (UID: \"d85bff45-4727-4a5e-be02-404fd7a56d0e\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:41.099923 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:41.099894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bd62\" (UniqueName: \"kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62\") pod \"test-curl-7742-140237449325856\" (UID: \"d85bff45-4727-4a5e-be02-404fd7a56d0e\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:41.240926 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:41.240852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:41.378306 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:41.378282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:41.380779 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:14:41.380753    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd85bff45_4727_4a5e_be02_404fd7a56d0e.slice/crio-1a26ea9b3d82c2e630c8b8d4cab4743407fda7f74ce5f909b160ce4f12dd3f0a WatchSource:0}: Error finding container 1a26ea9b3d82c2e630c8b8d4cab4743407fda7f74ce5f909b160ce4f12dd3f0a: Status 404 returned error can't find the container with id 1a26ea9b3d82c2e630c8b8d4cab4743407fda7f74ce5f909b160ce4f12dd3f0a
Jul 16 00:14:41.402709 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:41.402683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237449325856" event={"ID":"d85bff45-4727-4a5e-be02-404fd7a56d0e","Type":"ContainerStarted","Data":"1a26ea9b3d82c2e630c8b8d4cab4743407fda7f74ce5f909b160ce4f12dd3f0a"}
Jul 16 00:14:42.408746 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:42.408663    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85bff45-4727-4a5e-be02-404fd7a56d0e" containerID="3d4c11c625ba7e162360d1ae67274aaeecc86c5933e989f877a30880cf4769cb" exitCode=0
Jul 16 00:14:42.409097 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:42.408754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237449325856" event={"ID":"d85bff45-4727-4a5e-be02-404fd7a56d0e","Type":"ContainerDied","Data":"3d4c11c625ba7e162360d1ae67274aaeecc86c5933e989f877a30880cf4769cb"}
Jul 16 00:14:43.556598 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.556575    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:43.578065 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.578034    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-140237449325856_d85bff45-4727-4a5e-be02-404fd7a56d0e/test-curl-7742-140237449325856/0.log"
Jul 16 00:14:43.602142 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.602114    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:43.607415 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.607390    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:43.613782 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.613763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bd62\" (UniqueName: \"kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62\") pod \"d85bff45-4727-4a5e-be02-404fd7a56d0e\" (UID: \"d85bff45-4727-4a5e-be02-404fd7a56d0e\") "
Jul 16 00:14:43.615779 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.615759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62" (OuterVolumeSpecName: "kube-api-access-2bd62") pod "d85bff45-4727-4a5e-be02-404fd7a56d0e" (UID: "d85bff45-4727-4a5e-be02-404fd7a56d0e"). InnerVolumeSpecName "kube-api-access-2bd62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:14:43.714650 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.714562    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bd62\" (UniqueName: \"kubernetes.io/projected/d85bff45-4727-4a5e-be02-404fd7a56d0e-kube-api-access-2bd62\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:43.735776 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.735743    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:43.736137 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.736123    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85bff45-4727-4a5e-be02-404fd7a56d0e" containerName="test-curl-7742-140237449325856"
Jul 16 00:14:43.736137 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.736138    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85bff45-4727-4a5e-be02-404fd7a56d0e" containerName="test-curl-7742-140237449325856"
Jul 16 00:14:43.736250 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.736195    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85bff45-4727-4a5e-be02-404fd7a56d0e" containerName="test-curl-7742-140237449325856"
Jul 16 00:14:43.739196 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.739173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:43.744620 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.744593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:43.815292 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.815261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97pkx\" (UniqueName: \"kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx\") pod \"test-curl-7742-140237449325856\" (UID: \"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:43.916030 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.915988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97pkx\" (UniqueName: \"kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx\") pod \"test-curl-7742-140237449325856\" (UID: \"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:43.923719 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:43.923694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97pkx\" (UniqueName: \"kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx\") pod \"test-curl-7742-140237449325856\" (UID: \"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4\") " pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:44.050185 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.050149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:44.186349 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.186309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:44.188559 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:14:44.188535    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88a05fc_c3ff_4ef8_9ab7_b64855cce1a4.slice/crio-2f72113913f926a34e3fca8e16fc4a7be6131794869955324cc00be58fcc8f3c WatchSource:0}: Error finding container 2f72113913f926a34e3fca8e16fc4a7be6131794869955324cc00be58fcc8f3c: Status 404 returned error can't find the container with id 2f72113913f926a34e3fca8e16fc4a7be6131794869955324cc00be58fcc8f3c
Jul 16 00:14:44.419033 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.418945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237449325856" event={"ID":"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4","Type":"ContainerStarted","Data":"2f72113913f926a34e3fca8e16fc4a7be6131794869955324cc00be58fcc8f3c"}
Jul 16 00:14:44.420161 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.420134    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:44.420257 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.420164    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a26ea9b3d82c2e630c8b8d4cab4743407fda7f74ce5f909b160ce4f12dd3f0a"
Jul 16 00:14:44.431670 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.431641    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7742-140237449325856" oldPodUID="d85bff45-4727-4a5e-be02-404fd7a56d0e" podUID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4"
Jul 16 00:14:44.999230 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:44.999198    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85bff45-4727-4a5e-be02-404fd7a56d0e" path="/var/lib/kubelet/pods/d85bff45-4727-4a5e-be02-404fd7a56d0e/volumes"
Jul 16 00:14:45.426748 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:45.426715    2578 generic.go:356] "Generic (PLEG): container finished" podID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" containerID="a6bd6927857d7758cf4e9f98f58db464bc56ad53ae1008d04c281292946c779b" exitCode=0
Jul 16 00:14:45.426907 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:45.426766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-140237449325856" event={"ID":"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4","Type":"ContainerDied","Data":"a6bd6927857d7758cf4e9f98f58db464bc56ad53ae1008d04c281292946c779b"}
Jul 16 00:14:46.584883 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.584856    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:46.603309 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.603279    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-140237449325856_e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4/test-curl-7742-140237449325856/0.log"
Jul 16 00:14:46.625841 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.625808    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:46.628155 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.628133    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-140237449325856"]
Jul 16 00:14:46.638735 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.638711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97pkx\" (UniqueName: \"kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx\") pod \"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4\" (UID: \"e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4\") "
Jul 16 00:14:46.640784 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.640764    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx" (OuterVolumeSpecName: "kube-api-access-97pkx") pod "e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" (UID: "e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4"). InnerVolumeSpecName "kube-api-access-97pkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:14:46.739760 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.739678    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97pkx\" (UniqueName: \"kubernetes.io/projected/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4-kube-api-access-97pkx\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:46.996523 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:46.996423    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" path="/var/lib/kubelet/pods/e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4/volumes"
Jul 16 00:14:47.437983 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:47.437955    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-140237449325856"
Jul 16 00:14:47.438834 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:47.437932    2578 scope.go:117] "RemoveContainer" containerID="a6bd6927857d7758cf4e9f98f58db464bc56ad53ae1008d04c281292946c779b"
Jul 16 00:14:48.231439 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.231401    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" podUID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" containerName="main" containerID="cri-o://23522be8bf343ee6834e74758301f3ca41072a19e21dca6e7bff8bac1f57eb15" gracePeriod=45
Jul 16 00:14:48.295607 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.295570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:14:48.445383 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.445352    2578 generic.go:356] "Generic (PLEG): container finished" podID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" containerID="23522be8bf343ee6834e74758301f3ca41072a19e21dca6e7bff8bac1f57eb15" exitCode=0
Jul 16 00:14:48.445560 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.445428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" event={"ID":"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904","Type":"ContainerDied","Data":"23522be8bf343ee6834e74758301f3ca41072a19e21dca6e7bff8bac1f57eb15"}
Jul 16 00:14:48.509697 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.509667    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:14:48.555644 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.555644 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.555889 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.555889 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.555889 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.555889 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n88nh\" (UniqueName: \"kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh\") pod \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\" (UID: \"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904\") "
Jul 16 00:14:48.556069 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home" (OuterVolumeSpecName: "home") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:14:48.556069 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache" (OuterVolumeSpecName: "model-cache") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:14:48.556069 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.555982    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:14:48.556161 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.556117    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tmp-dir\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:48.556161 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.556133    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-model-cache\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:48.556161 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.556144    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-home\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:48.557993 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.557969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm" (OuterVolumeSpecName: "dshm") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:14:48.557993 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.557981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:14:48.558137 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.558006    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh" (OuterVolumeSpecName: "kube-api-access-n88nh") pod "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" (UID: "df5cd8f6-83ff-48f3-8c5a-8fdaa5322904"). InnerVolumeSpecName "kube-api-access-n88nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:14:48.656647 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.656613    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n88nh\" (UniqueName: \"kubernetes.io/projected/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-kube-api-access-n88nh\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:48.656647 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.656641    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-dshm\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:48.656647 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:48.656652    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904-tls-certs\") on node \"ip-10-0-133-3.ec2.internal\" DevicePath \"\""
Jul 16 00:14:49.452635 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:49.452603    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"
Jul 16 00:14:49.453045 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:49.452638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn" event={"ID":"df5cd8f6-83ff-48f3-8c5a-8fdaa5322904","Type":"ContainerDied","Data":"6e70b0305bd38843e3169a04e73562c6bfff8e7cf92b06f242e08e69c9fbfb22"}
Jul 16 00:14:49.453045 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:49.452687    2578 scope.go:117] "RemoveContainer" containerID="23522be8bf343ee6834e74758301f3ca41072a19e21dca6e7bff8bac1f57eb15"
Jul 16 00:14:49.468795 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:49.468773    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:14:49.474719 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:49.474698    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef3a1a/rate-test-model-ef3a1a-kserve-7c8cd65bc5-vtrhn"]
Jul 16 00:14:50.996764 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:14:50.996732    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" path="/var/lib/kubelet/pods/df5cd8f6-83ff-48f3-8c5a-8fdaa5322904/volumes"
Jul 16 00:15:04.887693 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:04.887652    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:15:12.584778 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:12.584749    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tpgww_261a8450-c7ac-4bda-b72f-0272246b7269/manager/0.log"
Jul 16 00:15:12.736920 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:12.736891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lg2pp_cbd89bd5-6432-4415-af25-20d76992a873/manager/0.log"
Jul 16 00:15:13.008672 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:13.008650    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6jlz7_a26e558f-7991-4fb9-8940-84572660349b/server/0.log"
Jul 16 00:15:13.144658 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:13.144627    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gz4zw_3c264be5-46bb-471d-b941-f2066f82bcab/manager/0.log"
Jul 16 00:15:13.392818 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:13.392736    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dcb68dc66-rjswv_7ac4e2f5-35ce-4f58-bd6a-7be9f286b109/copy-manifests/0.log"
Jul 16 00:15:13.404963 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:13.404938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dcb68dc66-rjswv_7ac4e2f5-35ce-4f58-bd6a-7be9f286b109/manager/0.log"
Jul 16 00:15:14.307929 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:14.307902    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-eae7a4-557f694bdd-wlscw_45567c4b-b6ec-44b8-8598-d829b1cbb125/maas-api/0.log"
Jul 16 00:15:14.692439 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:14.692362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dv2l"]
Jul 16 00:15:15.098362 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:15.098335    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-ef3a1a-6c7f5c47cb-l5bhx_a23fff65-fe30-4102-a147-2f01dbd31750/maas-api/0.log"
Jul 16 00:15:15.233365 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:15.233328    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-e94b3e-74cc5769cd-hk826_12c2879c-a614-4bcb-a30e-45a3ef477d2d/maas-api/0.log"
Jul 16 00:15:18.545096 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:18.545067    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k6vnd_d309bdae-e98b-4c1e-b41b-8e91e23550f1/manager/0.log"
Jul 16 00:15:18.683866 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:18.683776    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2zs6c_4b96f0f3-6578-419b-b2b0-dc137f914c2e/manager/0.log"
Jul 16 00:15:18.798881 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:18.798849    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xfrvq_5e7b6a1f-7189-4e3f-b069-a409bfe79609/kuadrant-console-plugin/0.log"
Jul 16 00:15:18.921122 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:18.921094    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9vdtp_5fcb4a75-263f-4662-a4a5-7a56ee3fcac8/registry-server/0.log"
Jul 16 00:15:19.053347 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:19.053317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-px47n_75f96d50-1aa0-439f-a1dd-8c60fdeb757e/manager/0.log"
Jul 16 00:15:19.183796 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:19.183773    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9dv2l_f95158ba-296d-4359-87c5-c3e6afcdc62f/limitador/0.log"
Jul 16 00:15:19.314175 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:19.314105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wg9xb_40bd4a10-2157-4b2a-af33-42d35db3b9d8/manager/0.log"
Jul 16 00:15:20.141771 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:20.141738    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6684b565-pwss8_31a79a5c-6d28-4f27-b569-e29489f1a4ff/kube-auth-proxy/0.log"
Jul 16 00:15:20.679952 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:20.679925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fb848bf5d-kvph8_268f567e-3cbc-42cc-b445-ca55101ca7f6/router/0.log"
Jul 16 00:15:21.600854 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:21.600815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jwwdk_7a80acb7-4772-4d0a-b95c-568c67421416/main/0.log"
Jul 16 00:15:21.751805 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:21.751779    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vd2ks_ea78c7e6-c0d0-4562-a933-e1c4904248b8/main/0.log"
Jul 16 00:15:31.755522 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:31.755477    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kj9l7_b1975b3d-03da-4558-aa15-1408d5b6c8a9/global-pull-secret-syncer/0.log"
Jul 16 00:15:31.873535 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:31.873505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tzgm7_6dc96ad5-da20-485b-87e1-bb21d8703401/konnectivity-agent/0.log"
Jul 16 00:15:31.940006 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:31.939977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-3.ec2.internal_dbbb0615f3fefa38a3af027c8dc6b0b2/haproxy/0.log"
Jul 16 00:15:37.027119 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.027092    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k6vnd_d309bdae-e98b-4c1e-b41b-8e91e23550f1/manager/0.log"
Jul 16 00:15:37.049124 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.049100    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2zs6c_4b96f0f3-6578-419b-b2b0-dc137f914c2e/manager/0.log"
Jul 16 00:15:37.072930 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.072905    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xfrvq_5e7b6a1f-7189-4e3f-b069-a409bfe79609/kuadrant-console-plugin/0.log"
Jul 16 00:15:37.124634 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.124603    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9vdtp_5fcb4a75-263f-4662-a4a5-7a56ee3fcac8/registry-server/0.log"
Jul 16 00:15:37.218387 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.218359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-px47n_75f96d50-1aa0-439f-a1dd-8c60fdeb757e/manager/0.log"
Jul 16 00:15:37.239833 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.239802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9dv2l_f95158ba-296d-4359-87c5-c3e6afcdc62f/limitador/0.log"
Jul 16 00:15:37.300636 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:37.300557    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wg9xb_40bd4a10-2157-4b2a-af33-42d35db3b9d8/manager/0.log"
Jul 16 00:15:39.322389 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:39.322363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hn5ss_cd39ec85-a7e1-4982-b41e-d49b94bdf088/node-exporter/0.log"
Jul 16 00:15:39.346091 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:39.346062    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hn5ss_cd39ec85-a7e1-4982-b41e-d49b94bdf088/kube-rbac-proxy/0.log"
Jul 16 00:15:39.369800 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:39.369777    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hn5ss_cd39ec85-a7e1-4982-b41e-d49b94bdf088/init-textfile/0.log"
Jul 16 00:15:41.953420 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953382    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"]
Jul 16 00:15:41.953813 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953751    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" containerName="main"
Jul 16 00:15:41.953813 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953762    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" containerName="main"
Jul 16 00:15:41.953813 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953769    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" containerName="test-curl-7742-140237449325856"
Jul 16 00:15:41.953813 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953775    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" containerName="test-curl-7742-140237449325856"
Jul 16 00:15:41.954019 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953835    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88a05fc-c3ff-4ef8-9ab7-b64855cce1a4" containerName="test-curl-7742-140237449325856"
Jul 16 00:15:41.954019 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.953845    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5cd8f6-83ff-48f3-8c5a-8fdaa5322904" containerName="main"
Jul 16 00:15:41.956838 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.956820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:41.959208 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.959184    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-px62w\"/\"kube-root-ca.crt\""
Jul 16 00:15:41.959331 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.959229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-px62w\"/\"openshift-service-ca.crt\""
Jul 16 00:15:41.959331 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.959279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-px62w\"/\"default-dockercfg-88t76\""
Jul 16 00:15:41.965918 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.965896    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"]
Jul 16 00:15:41.996515 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:41.996475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kgcx9_db9d2a0f-2ab0-4957-b571-5e1a1913e125/console-operator/0.log"
Jul 16 00:15:42.035502 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.035467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-lib-modules\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.035681 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.035527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-podres\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.035681 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.035547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6bn\" (UniqueName: \"kubernetes.io/projected/67cad239-7317-4261-add7-e512ee611a9d-kube-api-access-hn6bn\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.035681 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.035602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-sys\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.035681 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.035618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-proc\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.136823 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-lib-modules\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.136823 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-podres\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6bn\" (UniqueName: \"kubernetes.io/projected/67cad239-7317-4261-add7-e512ee611a9d-kube-api-access-hn6bn\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-sys\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-proc\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-podres\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.136989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-sys\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.137005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-proc\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.137076 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.137052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67cad239-7317-4261-add7-e512ee611a9d-lib-modules\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.144717 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.144693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6bn\" (UniqueName: \"kubernetes.io/projected/67cad239-7317-4261-add7-e512ee611a9d-kube-api-access-hn6bn\") pod \"perf-node-gather-daemonset-sdmxp\" (UID: \"67cad239-7317-4261-add7-e512ee611a9d\") " pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.267308 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.267280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:42.611542 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.611355    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"]
Jul 16 00:15:42.614592 ip-10-0-133-3 kubenswrapper[2578]: W0716 00:15:42.614559    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67cad239_7317_4261_add7_e512ee611a9d.slice/crio-67836dea34583a33666280cbfe7feb8d0c87a879bf84660bc7ec325ac06f223e WatchSource:0}: Error finding container 67836dea34583a33666280cbfe7feb8d0c87a879bf84660bc7ec325ac06f223e: Status 404 returned error can't find the container with id 67836dea34583a33666280cbfe7feb8d0c87a879bf84660bc7ec325ac06f223e
Jul 16 00:15:42.699261 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:42.699222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp" event={"ID":"67cad239-7317-4261-add7-e512ee611a9d","Type":"ContainerStarted","Data":"67836dea34583a33666280cbfe7feb8d0c87a879bf84660bc7ec325ac06f223e"}
Jul 16 00:15:43.705935 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:43.705889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp" event={"ID":"67cad239-7317-4261-add7-e512ee611a9d","Type":"ContainerStarted","Data":"f4f59a9a1a491170857332d02a61f802eb16417bd618b0fafc1c3fd0e562d954"}
Jul 16 00:15:43.707470 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:43.707441    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:43.723348 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:43.723299    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp" podStartSLOduration=2.7232851890000003 podStartE2EDuration="2.723285189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:15:43.722281483 +0000 UTC m=+2389.254110490" watchObservedRunningTime="2026-07-16 00:15:43.723285189 +0000 UTC m=+2389.255114190"
Jul 16 00:15:44.218150 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:44.218119    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6ndlh_ccadbeac-a59c-4ef9-a075-dbb35fb22483/dns/0.log"
Jul 16 00:15:44.239757 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:44.239732    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6ndlh_ccadbeac-a59c-4ef9-a075-dbb35fb22483/kube-rbac-proxy/0.log"
Jul 16 00:15:44.394388 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:44.394356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbzgm_040f26c4-7552-482d-8f38-69ea79e0b858/dns-node-resolver/0.log"
Jul 16 00:15:44.933165 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:44.933139    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-688cb9ddc4-z8hjw_09b0479c-fdd4-4ada-9f17-4949b626d828/registry/0.log"
Jul 16 00:15:44.951847 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:44.951826    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9bzt_329c8b35-9a1e-45d8-8220-7a1f339f9d9b/node-ca/0.log"
Jul 16 00:15:46.198216 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:46.198185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6684b565-pwss8_31a79a5c-6d28-4f27-b569-e29489f1a4ff/kube-auth-proxy/0.log"
Jul 16 00:15:46.363621 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:46.363593    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fb848bf5d-kvph8_268f567e-3cbc-42cc-b445-ca55101ca7f6/router/0.log"
Jul 16 00:15:47.038038 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:47.038003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bt76l_1b479cb4-01b8-4854-9b07-f1eafd6106c8/serve-healthcheck-canary/0.log"
Jul 16 00:15:47.702372 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:47.702344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdkhk_9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb/kube-rbac-proxy/0.log"
Jul 16 00:15:47.722671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:47.722640    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdkhk_9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb/exporter/0.log"
Jul 16 00:15:47.745406 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:47.745379    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdkhk_9558ebb1-4d7f-4cd1-a775-96dde5bfc1fb/extractor/0.log"
Jul 16 00:15:49.803904 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:49.803873    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tpgww_261a8450-c7ac-4bda-b72f-0272246b7269/manager/0.log"
Jul 16 00:15:49.936061 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:49.936033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lg2pp_cbd89bd5-6432-4415-af25-20d76992a873/manager/0.log"
Jul 16 00:15:50.135264 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:50.135183    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6jlz7_a26e558f-7991-4fb9-8940-84572660349b/server/0.log"
Jul 16 00:15:50.200421 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:50.200394    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gz4zw_3c264be5-46bb-471d-b941-f2066f82bcab/manager/0.log"
Jul 16 00:15:50.320176 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:50.320143    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dcb68dc66-rjswv_7ac4e2f5-35ce-4f58-bd6a-7be9f286b109/manager/0.log"
Jul 16 00:15:50.337353 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:50.337326    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dcb68dc66-rjswv_7ac4e2f5-35ce-4f58-bd6a-7be9f286b109/copy-manifests/0.log"
Jul 16 00:15:50.724847 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:50.724822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-px62w/perf-node-gather-daemonset-sdmxp"
Jul 16 00:15:52.241017 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:52.240989    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6684b565-pwss8_31a79a5c-6d28-4f27-b569-e29489f1a4ff/kube-auth-proxy/0.log"
Jul 16 00:15:52.380623 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:52.380600    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fb848bf5d-kvph8_268f567e-3cbc-42cc-b445-ca55101ca7f6/router/0.log"
Jul 16 00:15:53.876518 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:53.876471    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6684b565-pwss8_31a79a5c-6d28-4f27-b569-e29489f1a4ff/kube-auth-proxy/0.log"
Jul 16 00:15:54.028903 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:54.028870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fb848bf5d-kvph8_268f567e-3cbc-42cc-b445-ca55101ca7f6/router/0.log"
Jul 16 00:15:58.023035 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.023005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/kube-multus-additional-cni-plugins/0.log"
Jul 16 00:15:58.044309 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.044282    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/egress-router-binary-copy/0.log"
Jul 16 00:15:58.065946 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.065919    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/cni-plugins/0.log"
Jul 16 00:15:58.087619 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.087591    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/bond-cni-plugin/0.log"
Jul 16 00:15:58.109398 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.109365    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/routeoverride-cni/0.log"
Jul 16 00:15:58.129202 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.129163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/whereabouts-cni-bincopy/0.log"
Jul 16 00:15:58.148745 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.148726    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cc8n7_4760bda5-6aa1-443a-bfc6-ec01b1842b8b/whereabouts-cni/0.log"
Jul 16 00:15:58.472671 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.472605    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g6njm_298966ad-fea8-49d8-8b61-55b075cb6704/kube-multus/0.log"
Jul 16 00:15:58.616176 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.616153    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhc56_64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8/network-metrics-daemon/0.log"
Jul 16 00:15:58.635697 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:58.635674    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhc56_64d8c33f-c59c-4679-bdcb-ad2fb53f1cb8/kube-rbac-proxy/0.log"
Jul 16 00:15:59.869719 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.869670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/ovn-controller/0.log"
Jul 16 00:15:59.886352 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.886322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/ovn-acl-logging/0.log"
Jul 16 00:15:59.906758 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.906736    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/kube-rbac-proxy-node/0.log"
Jul 16 00:15:59.926011 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.925989    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/kube-rbac-proxy-ovn-metrics/0.log"
Jul 16 00:15:59.944734 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.944706    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/northd/0.log"
Jul 16 00:15:59.966448 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.966424    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/nbdb/0.log"
Jul 16 00:15:59.988863 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:15:59.988843    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/sbdb/0.log"
Jul 16 00:16:00.035947 ip-10-0-133-3 kubenswrapper[2578]: I0716 00:16:00.035916    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npzts_f08933b4-ce91-403c-92e9-49b0ba0319a5/ovnkube-controller/0.log"