Jul 09 13:29:21.246583 ip-10-0-133-38 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 13:29:21.670950 ip-10-0-133-38 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:21.670950 ip-10-0-133-38 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 13:29:21.670950 ip-10-0-133-38 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:21.670950 ip-10-0-133-38 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 13:29:21.670950 ip-10-0-133-38 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:21.673430 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.673339    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 13:29:21.679625 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679604    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679628    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679636    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679642    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679650    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679656    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679661    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679666    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.679672 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679672    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679689    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679695    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679699    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679704    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679708    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679712    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679716    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679721    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679726    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679730    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679735    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679740    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679744    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679748    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679753    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679757    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679761    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679766    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679770    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679775    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.679860 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679779    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679784    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679788    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679792    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679797    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679801    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679806    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679812    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679816    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679823    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679827    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679831    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679835    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679840    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679844    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679849    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679853    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679856    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679860    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.680398 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679864    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679869    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679873    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679877    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679881    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679885    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679889    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679893    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679900    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679907    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679911    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679916    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679921    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679925    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679929    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679933    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679938    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679942    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679947    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.680954 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679952    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679956    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679961    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679964    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679969    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679973    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679977    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679983    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679988    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679992    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.679996    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680000    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680004    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680009    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680013    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680017    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680022    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680026    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680032    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.681416 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680039    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680043    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680053    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680058    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680062    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680067    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680071    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680075    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680079    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680082    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680087    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680091    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.681871 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.680095    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.682453 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682440    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.682453 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682452    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682455    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682460    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682463    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682467    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682470    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682473    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682478    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682482    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682485    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682488    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682491    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682493    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682496    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682499    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682501    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682504    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682507    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682509    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.682512 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682512    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682514    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682517    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682520    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682523    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682526    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682528    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682531    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682534    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682536    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682539    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682541    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682544    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682546    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682548    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682551    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682553    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682556    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682559    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.683011 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682562    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682564    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682567    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682569    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682572    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682574    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682577    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682579    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682581    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682584    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682586    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682589    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682591    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682596    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682599    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682603    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682607    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682610    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682613    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.683494 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682616    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682618    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682621    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682624    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682626    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682628    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682631    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682633    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682636    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682638    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682641    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682643    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682646    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682649    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682652    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682655    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682657    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682660    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682662    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682665    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682667    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.683952 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682671    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682674    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682676    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682679    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682682    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682684    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682687    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682690    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682694    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682698    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682700    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682703    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682705    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682708    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682710    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682713    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682715    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682718    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682721    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.682723    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.684473 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683093    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683097    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683100    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683104    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683107    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683110    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683113    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683116    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683119    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683121    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683124    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683127    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683129    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683132    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683135    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683137    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683140    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683143    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683145    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.684955 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683148    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683151    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683153    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683156    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683159    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683161    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683164    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683166    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683169    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683172    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683174    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683177    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683180    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683182    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683185    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683188    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683190    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683193    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683196    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.685441 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683200    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683204    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683207    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683210    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683212    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683215    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683217    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683220    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683222    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683225    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683228    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683230    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683234    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683236    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683239    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683241    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683244    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683263    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683266    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683269    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.685892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683272    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683274    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683277    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683280    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683283    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683285    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683288    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683291    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683293    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683296    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683298    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683301    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683305    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683308    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683310    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683313    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683315    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683317    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683320    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683322    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.686400 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683325    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683328    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683330    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683333    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683337    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683339    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683342    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683344    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683347    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683349    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683352    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683354    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683357    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683361    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683365    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683368    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683371    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683374    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683377    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.686878 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683380    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.683384    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683459    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683482    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683492    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683499    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683508    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683511    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683515    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683520    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683523    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683526    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683530    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683533    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683537    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683540    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683543    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683546    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683549    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683552    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683556    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683559    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683562    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 13:29:21.687340 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683566    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683569    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683573    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683576    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683579    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683582    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683585    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683588    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683591    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683594    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683597    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683601    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683604    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683607    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683610    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683613    2561 flags.go:64] FLAG: --enable-server="true"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683617    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683622    2561 flags.go:64] FLAG: --event-burst="100"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683625    2561 flags.go:64] FLAG: --event-qps="50"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683631    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683634    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683637    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683641    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683644    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683647    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 13:29:21.687899 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683649    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683652    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683655    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683658    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683661    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683664    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683667    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683670    2561 flags.go:64] FLAG: --feature-gates=""
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683673    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683677    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683680    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683682    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683686    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683688    2561 flags.go:64] FLAG: --help="false"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683691    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683694    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683697    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683700    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683705    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683708    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683711    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683714    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683717    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 13:29:21.688537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683719    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683723    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683727    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683732    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683735    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683738    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683741    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683744    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683747    2561 flags.go:64] FLAG: --lock-file=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683750    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683752    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683755    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683761    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683764    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683767    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683769    2561 flags.go:64] FLAG: --logging-format="text"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683772    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683775    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683778    2561 flags.go:64] FLAG: --manifest-url=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683781    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683785    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683788    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683792    2561 flags.go:64] FLAG: --max-pods="110"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683796    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683798    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 13:29:21.689126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683801    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683805    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683812    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683816    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683819    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683827    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683830    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683833    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683837    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683840    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683846    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683850    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683853    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683856    2561 flags.go:64] FLAG: --port="10250"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683859    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683862    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04dc3731e9de22a79"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683865    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683868    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683871    2561 flags.go:64] FLAG: --register-node="true"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683874    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683878    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683881    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683884    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683887    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683891    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 13:29:21.689755 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683894    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683897    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683900    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683903    2561 flags.go:64] FLAG: --runonce="false"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683906    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683909    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683912    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683915    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683917    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683922    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683925    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683928    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683931    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683934    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683937    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683940    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683943    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683946    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683951    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683957    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683960    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683963    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683967    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683970    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683973    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 13:29:21.690377 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683976    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683979    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683982    2561 flags.go:64] FLAG: --v="2"
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683985    2561 flags.go:64] FLAG: --version="false"
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683990    2561 flags.go:64] FLAG: --vmodule=""
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.683996    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.684000    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684122    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684126    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684129    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684132    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684135    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684137    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684140    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684143    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684146    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684150    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684152    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684155    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684158    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684160    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.690978 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684163    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684166    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684168    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684171    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684176    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684179    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684181    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684184    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684187    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684189    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684192    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684194    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684197    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684199    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684202    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684204    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684207    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684209    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684212    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.691498 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684214    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684217    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684220    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684222    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684225    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684227    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684230    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684232    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684236    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684238    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684241    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684243    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684261    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684265    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684267    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684270    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684273    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684277    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684280    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684283    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.691992 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684286    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684288    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684291    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684294    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684296    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684299    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684301    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684304    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684307    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684309    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684312    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684314    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684318    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684322    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684326    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684329    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684332    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684335    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684337    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684340    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.692574 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684344    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684347    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684349    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684352    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684354    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684358    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684361    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684364    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684367    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684370    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684373    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684376    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684379    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684381    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684384    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684387    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684389    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684392    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684396    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684399    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.693066 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684402    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684405    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684408    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684411    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684414    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.684417    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.685240    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.692351    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.692365    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.692387    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.692393    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692449    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692454    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692457    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692461    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.693569 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692464    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692467    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692470    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692473    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692476    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692480    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692483    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692486    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692488    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692491    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692494    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692497    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692499    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692502    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692504    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692507    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692510    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692512    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692515    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692517    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.693953 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692520    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692523    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692526    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692528    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692531    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692535    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692538    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692541    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692543    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692546    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692549    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692552    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692555    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692557    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692561    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692565    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692568    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692571    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692574    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.694452 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692577    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692580    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692583    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692586    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692589    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692592    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692594    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692598    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692601    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692604    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692607    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692610    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692613    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692616    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692618    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692621    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692624    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692627    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692630    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692634    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.694919 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692636    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692639    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692641    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692644    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692646    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692649    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692652    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692655    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692658    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692660    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692662    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692665    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692667    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692670    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692672    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692675    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692677    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692680    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692683    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692685    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.695413 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692688    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692690    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692693    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692697    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692700    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692704    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692707    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692709    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692712    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692715    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692719    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692722    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692725    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692728    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692731    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.695896 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692733    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.692739    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692857    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692862    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692865    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692868    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692870    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692874    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692876    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692879    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692881    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692885    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692889    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692892    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:21.696266 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692895    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692898    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692901    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692903    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692906    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692910    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692913    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692916    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692918    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692921    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692924    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692927    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692930    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692932    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692935    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692938    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692942    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692946    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692949    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692952    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:21.696618 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692955    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692957    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692960    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692963    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692965    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692968    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692971    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692973    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692976    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692978    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692981    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692983    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692986    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692989    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692991    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692994    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.692996    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693000    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693002    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693004    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:21.697100 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693007    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693009    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693012    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693014    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693017    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693019    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693022    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693025    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693027    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693030    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693033    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693035    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693038    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693040    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693043    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693045    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693048    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693050    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693053    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:21.697594 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693055    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693058    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693060    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693064    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693068    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693071    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693074    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693077    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693080    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693082    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693085    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693088    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693090    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693093    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693095    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693098    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693100    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693103    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693105    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:21.698074 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693108    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693111    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693113    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693116    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693119    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693121    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693124    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693126    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:21.693129    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.693134    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.693244    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.695543    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.697120    2561 server.go:1019] "Starting client certificate rotation"
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.697217    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 13:29:21.698597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.697267    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 13:29:21.700090 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.700076    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 13:29:21.704733 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.704708    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 13:29:21.713459 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.713442    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 09 13:29:21.717788 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.717772    2561 log.go:25] "Validated CRI v1 image API"
Jul 09 13:29:21.719560 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.719543    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 13:29:21.724305 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.724286    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b44bc378-ef41-423a-a211-42f63b51effa:/dev/nvme0n1p4 eb83a3df-f5c7-48ea-aa41-074e8877ac54:/dev/nvme0n1p3]
Jul 09 13:29:21.724360 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.724304    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 13:29:21.729530 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.729411    2561 manager.go:216] Machine: {Timestamp:2026-07-09 13:29:21.728006242 +0000 UTC m=+0.371735349 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099487 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec259bbbb8e2fbc096b6000deb6bed56 SystemUUID:ec259bbb-b8e2-fbc0-96b6-000deb6bed56 BootID:17fb0824-ced5-45dc-bd92-aca4541c29b0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:3a:dd:37:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:3a:dd:37:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:6e:81:be:82:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 13:29:21.729530 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.729522    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 13:29:21.729664 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.729641    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 13:29:21.730689 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.730672    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 13:29:21.732980 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.732952    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 13:29:21.733119 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.732983    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 13:29:21.733882 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.733872    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 13:29:21.733924 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.733885    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 13:29:21.733924 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.733900    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 13:29:21.734661 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.734650    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 13:29:21.736438 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.736428    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 13:29:21.740011 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.739999    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 13:29:21.740132 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740122    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 13:29:21.740167 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740153    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 13:29:21.740167 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740163    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 13:29:21.740228 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740177    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 13:29:21.740228 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740186    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 09 13:29:21.740228 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740195    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 13:29:21.740660 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740647    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 13:29:21.740713 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.740674    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 13:29:21.743000 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.742985    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 13:29:21.745286 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.745273    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 13:29:21.745328 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.745304    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 13:29:21.746653 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746641    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746657    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746663    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746668    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746677    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746682    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746690    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746695    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746701    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746706    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746715    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 13:29:21.746717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.746720    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 13:29:21.747870 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.747845    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 13:29:21.748057 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.748029    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 13:29:21.750853 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.750828    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 13:29:21.750936 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.750876    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 13:29:21.750936 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.750876    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 13:29:21.751825 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.751811    2561 server.go:1268] "Started kubelet"
Jul 09 13:29:21.752201 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.752111    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 13:29:21.752283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.752139    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 13:29:21.752371 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.752350    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 13:29:21.752920 ip-10-0-133-38 systemd[1]: Started Kubernetes Kubelet.
Jul 09 13:29:21.758781 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.758698    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbgrx"
Jul 09 13:29:21.758781 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.758758    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 13:29:21.759705 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.759690    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 13:29:21.759786 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.759704    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 13:29:21.762975 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.762959    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbgrx"
Jul 09 13:29:21.764240 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.763079    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-38.ec2.internal.18c0a22bdf43ebd0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-38.ec2.internal,UID:ip-10-0-133-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-38.ec2.internal,},FirstTimestamp:2026-07-09 13:29:21.751780304 +0000 UTC m=+0.395509409,LastTimestamp:2026-07-09 13:29:21.751780304 +0000 UTC m=+0.395509409,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-38.ec2.internal,}"
Jul 09 13:29:21.768749 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.768727    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 13:29:21.768749 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.768741    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 13:29:21.768886 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.768867    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:21.769563 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.769548    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 13:29:21.769563 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.769552    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 13:29:21.769712 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.769572    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 13:29:21.769712 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.769677    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 13:29:21.769712 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.769685    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 13:29:21.771563 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771546    2561 factory.go:55] Registering systemd factory
Jul 09 13:29:21.771563 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771564    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 09 13:29:21.771800 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771785    2561 factory.go:153] Registering CRI-O factory
Jul 09 13:29:21.771800 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771800    2561 factory.go:223] Registration of the crio container factory successfully
Jul 09 13:29:21.771911 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771845    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 13:29:21.771911 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771866    2561 factory.go:103] Registering Raw factory
Jul 09 13:29:21.771911 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.771879    2561 manager.go:1196] Started watching for new ooms in manager
Jul 09 13:29:21.772328 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.772314    2561 manager.go:349] Starting recovery of all containers
Jul 09 13:29:21.779048 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.779002    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:21.783466 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.783147    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-38.ec2.internal\" not found" node="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:21.783593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.783574    2561 manager.go:354] Recovery completed
Jul 09 13:29:21.790117 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.790103    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:21.791817 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.791796    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:21.791887 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.791834    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:21.791887 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.791851    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:21.792429 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.792412    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 13:29:21.792429 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.792426    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 13:29:21.792578 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.792437    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:21.792578 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.792442    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 13:29:21.793301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793285    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:21.793356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793312    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:21.793356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793322    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:21.793625 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793614    2561 policy_none.go:49] "None policy: Start"
Jul 09 13:29:21.793668 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793629    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 13:29:21.793668 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.793639    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 13:29:21.794505 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.794494    2561 policy_none.go:47] "Start"
Jul 09 13:29:21.825970 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.825796    2561 manager.go:337] "Starting Device Plugin manager"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.825993    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826007    2561 server.go:87] "Starting device plugin registration server"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826235    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826246    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826389    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826505    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.826513    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.827188    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 13:29:21.835521 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.827241    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:21.915593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.915549    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 13:29:21.916720 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.916694    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 13:29:21.916819 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.916744    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 13:29:21.916819 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.916774    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 13:29:21.916911 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.916818    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 13:29:21.919299 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.919275    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:21.927240 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.927195    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:21.928064 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.928047    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:21.928131 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.928081    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:21.928131 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.928093    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:21.928131 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.928115    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:21.939435 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:21.939420    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:21.939509 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.939440    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-38.ec2.internal\": node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:21.960989 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:21.960967    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.017384 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.017341    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"]
Jul 09 13:29:22.017504 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.017437    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:22.018966 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.018952    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:22.019023 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.018981    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:22.019023 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.018991    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:22.020237 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.020225    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:22.020355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.020348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.020406 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.020379    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:22.020978 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.020961    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:22.021047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.020992    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:22.021047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.021007    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:22.021047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.021010    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:22.021047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.021031    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:22.021047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.021044    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:22.022199 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.022183    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.022264 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.022216    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:22.022878 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.022857    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:22.022967 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.022887    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:22.022967 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.022902    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:22.053981 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.053960    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-38.ec2.internal\" not found" node="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.058225 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.058207    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-38.ec2.internal\" not found" node="ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.061307 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.061292    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.072121 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.072102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.072205 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.072126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.072205 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.072146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6791fcd4f6fea18b3ec6770f8f5ef69-config\") pod \"kube-apiserver-proxy-ip-10-0-133-38.ec2.internal\" (UID: \"a6791fcd4f6fea18b3ec6770f8f5ef69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.162293 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.162241    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.172610 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.172728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.172728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6791fcd4f6fea18b3ec6770f8f5ef69-config\") pod \"kube-apiserver-proxy-ip-10-0-133-38.ec2.internal\" (UID: \"a6791fcd4f6fea18b3ec6770f8f5ef69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.172728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.172728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172690    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f290281af5a433be33c1242706052e89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal\" (UID: \"f290281af5a433be33c1242706052e89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.172728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.172690    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6791fcd4f6fea18b3ec6770f8f5ef69-config\") pod \"kube-apiserver-proxy-ip-10-0-133-38.ec2.internal\" (UID: \"a6791fcd4f6fea18b3ec6770f8f5ef69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.263096 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.263021    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.356586 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.356562    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.361731 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:22.361714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:22.363858 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.363841    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.464376 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.464331    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:22.564912 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:22.564847    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.406138 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.406108    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.436509 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.436483    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 13:29:24.437044 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.436636    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 13:29:24.437044 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.436643    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 13:29:24.506569 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.506539    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.509994 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.509969    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:24:23 +0000 UTC" deadline="2027-12-14 04:24:38.509611731 +0000 UTC"
Jul 09 13:29:24.510047 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.509995    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12542h55m13.999620071s"
Jul 09 13:29:24.607314 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.607253    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.655023 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:24.654990    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf290281af5a433be33c1242706052e89.slice/crio-130a2a522fa90efa8e86821f6cedc92f2e82c0dd3271669e0eb43ebc2885975c WatchSource:0}: Error finding container 130a2a522fa90efa8e86821f6cedc92f2e82c0dd3271669e0eb43ebc2885975c: Status 404 returned error can't find the container with id 130a2a522fa90efa8e86821f6cedc92f2e82c0dd3271669e0eb43ebc2885975c
Jul 09 13:29:24.655295 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:24.655274    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6791fcd4f6fea18b3ec6770f8f5ef69.slice/crio-ed932c0cbdb620cf939e9107a17dd5d58f7e5f1deb58d7f39664a53bbad81cb6 WatchSource:0}: Error finding container ed932c0cbdb620cf939e9107a17dd5d58f7e5f1deb58d7f39664a53bbad81cb6: Status 404 returned error can't find the container with id ed932c0cbdb620cf939e9107a17dd5d58f7e5f1deb58d7f39664a53bbad81cb6
Jul 09 13:29:24.660020 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.660005    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:29:24.661066 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.661020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal" event={"ID":"f290281af5a433be33c1242706052e89","Type":"ContainerStarted","Data":"130a2a522fa90efa8e86821f6cedc92f2e82c0dd3271669e0eb43ebc2885975c"}
Jul 09 13:29:24.662073 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:24.662047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal" event={"ID":"a6791fcd4f6fea18b3ec6770f8f5ef69","Type":"ContainerStarted","Data":"ed932c0cbdb620cf939e9107a17dd5d58f7e5f1deb58d7f39664a53bbad81cb6"}
Jul 09 13:29:24.708295 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.708267    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.808781 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.808742    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:24.909240 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:24.909214    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:25.010070 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.010047    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-38.ec2.internal\" not found"
Jul 09 13:29:25.021104 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.021074    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:25.087847 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.087824    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:25.110080 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.110053    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:25.123066 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.123044    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 13:29:25.124512 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.124496    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal"
Jul 09 13:29:25.135749 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.135728    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 13:29:25.482398 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.482364    2561 apiserver.go:52] "Watching apiserver"
Jul 09 13:29:25.489280 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.489248    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 13:29:25.489769 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.489745    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lpwhz","kube-system/konnectivity-agent-l2xzf","kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79","openshift-image-registry/node-ca-p6wxt","openshift-multus/multus-mgrfz","openshift-multus/network-metrics-daemon-6nwbb","openshift-network-diagnostics/network-check-target-kr6fg","openshift-ovn-kubernetes/ovnkube-node-g492b","kube-system/global-pull-secret-syncer-cnqdj","openshift-cluster-node-tuning-operator/tuned-dt5mm","openshift-dns/node-resolver-jqpvs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-8hk4h"]
Jul 09 13:29:25.491641 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.491620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.491739 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.491707    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:25.492799 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.492630    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.494975 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.494910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.495952 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.495780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.495952 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.495900    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.496107 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.495902    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.496193 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.496175    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-92tr2\""
Jul 09 13:29:25.497208 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.497172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.498520 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.498496    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 13:29:25.498813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.498644    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.498813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.498679    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 13:29:25.498813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.498742    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.498813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.498681    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 13:29:25.499402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.499191    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m77sp\""
Jul 09 13:29:25.499402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.499225    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.499402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.499315    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 13:29:25.500123 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.500101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.500505 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.500484    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nz8br\""
Jul 09 13:29:25.500720 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.500682    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.500796 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.500752    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.501158 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.501137    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 13:29:25.501423 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.501403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.501666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.501652    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5svrk\""
Jul 09 13:29:25.502267 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.502063    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.502267 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.502197    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 13:29:25.502749 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.502679    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xlfqp\""
Jul 09 13:29:25.503794 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.503769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:25.503966 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.503869    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505145    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d8h2x\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505212    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 13:29:25.507402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.505897    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 13:29:25.509629 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.509611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.511532 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.510049    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 13:29:25.511631 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.511540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.511631 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.511617    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:25.512664 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.512067    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 13:29:25.512664 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.512266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v57kt\""
Jul 09 13:29:25.512664 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.512462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 13:29:25.514150 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.513017    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.517493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.516007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.517493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.516625    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxw6r\""
Jul 09 13:29:25.517493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.516877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 13:29:25.517493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.517111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.517493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.517196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.519128 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.518217    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 13:29:25.519128 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.518544    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 13:29:25.519128 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.518810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjv59\""
Jul 09 13:29:25.522257 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-systemd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.522355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-konnectivity-ca\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.522355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.522355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-systemd-units\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522553 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-config\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522553 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-multus-daemon-config\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.522661 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-agent-certs\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.522661 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-kubelet\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522753 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-ovn\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522753 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-netd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522753 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-script-lib\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522753 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-kubelet-config\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-sys\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbspl\" (UniqueName: \"kubernetes.io/projected/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kube-api-access-cbspl\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-etc-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovn-node-metrics-cert\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-cni-binary-copy\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-netns\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.522964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-env-overrides\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-cnibin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysconfig\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-tuned\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-sys-fs\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-system-cni-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmstj\" (UniqueName: \"kubernetes.io/projected/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-kube-api-access-fmstj\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-dbus\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-modprobe-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-node-log\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-conf\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-run\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.523301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-registration-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf747d62-8793-4599-89b4-88000c3f56e6-serviceca\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v62wl\" (UniqueName: \"kubernetes.io/projected/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-kube-api-access-v62wl\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksg2p\" (UniqueName: \"kubernetes.io/projected/cf747d62-8793-4599-89b4-88000c3f56e6-kube-api-access-ksg2p\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-netns\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-systemd\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-socket-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-socket-dir-parent\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-multus\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xq84\" (UniqueName: \"kubernetes.io/projected/5462ff1f-52b4-493d-8424-45c974d2236c-kube-api-access-5xq84\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-tmp\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.524135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-k8s-cni-cncf-io\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-hostroot\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.522588    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.523771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-var-lib-kubelet\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-host\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qg8n\" (UniqueName: \"kubernetes.io/projected/4cbe5751-0d50-46a0-913e-c9cb878d23d8-kube-api-access-9qg8n\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-os-release\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-slash\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-log-socket\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-kubelet\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf747d62-8793-4599-89b4-88000c3f56e6-host\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-system-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-os-release\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-bin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.525075 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-kubernetes\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-var-lib-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-bin\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cnibin\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-conf-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-multus-certs\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mq6c\" (UniqueName: \"kubernetes.io/projected/b4d2d242-cfe3-4627-9315-35409c07b563-kube-api-access-5mq6c\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-device-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-etc-kubernetes\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.526069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.524831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-lib-modules\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.547792 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.547752    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvgp4"
Jul 09 13:29:25.550102 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.550068    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:25.556132 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.556113    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvgp4"
Jul 09 13:29:25.611503 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.611471    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 13:29:25.625170 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-var-lib-kubelet\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.625170 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-host\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qg8n\" (UniqueName: \"kubernetes.io/projected/4cbe5751-0d50-46a0-913e-c9cb878d23d8-kube-api-access-9qg8n\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-os-release\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-slash\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-log-socket\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.625356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e80b292-c67c-437a-a2ff-003294aa90ff-iptables-alerter-script\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-kubelet\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf747d62-8793-4599-89b4-88000c3f56e6-host\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-system-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-os-release\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-bin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-kubernetes\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-var-lib-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-bin\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cnibin\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-conf-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-multus-certs\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.625666 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mq6c\" (UniqueName: \"kubernetes.io/projected/b4d2d242-cfe3-4627-9315-35409c07b563-kube-api-access-5mq6c\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625695    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-kubelet\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-device-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-etc-kubernetes\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625771    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-var-lib-kubelet\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-lib-modules\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625824    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-host\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-systemd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625857    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-kubernetes\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-hosts-file\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625907    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf747d62-8793-4599-89b4-88000c3f56e6-host\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625932    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-lib-modules\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-bin\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625971    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-system-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-tmp-dir\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625994    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cnibin\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625997    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-device-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.626325 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.625701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-var-lib-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626030    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-os-release\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-konnectivity-ca\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-bin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-systemd-units\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-config\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626191    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626200    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-cni-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626224    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-systemd-units\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626237    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-log-socket\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626271    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-os-release\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626279    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-slash\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626303    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-multus-certs\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-systemd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627172 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626338    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-conf-dir\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-etc-kubernetes\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-multus-daemon-config\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-agent-certs\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-kubelet\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-ovn\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-netd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-script-lib\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626774    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-kubelet\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626856    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626879    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-config\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626880    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-konnectivity-ca\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.626890    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-cni-netd\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-kubelet-config\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627020    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-ovn\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-sys\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627124    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-kubelet-config\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.627985 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbspl\" (UniqueName: \"kubernetes.io/projected/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kube-api-access-cbspl\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627168    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-etc-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovn-node-metrics-cert\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-cni-binary-copy\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627243    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-sys\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627283    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-etc-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627285    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-multus-daemon-config\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-netns\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-env-overrides\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64hh\" (UniqueName: \"kubernetes.io/projected/3e80b292-c67c-437a-a2ff-003294aa90ff-kube-api-access-p64hh\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627513    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-netns\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627531    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovnkube-script-lib\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627713    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4d2d242-cfe3-4627-9315-35409c07b563-cni-binary-copy\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-cnibin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysconfig\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627804    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-cnibin\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-tuned\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.628826 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysconfig\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-sys-fs\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627896    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-env-overrides\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-system-cni-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-sys-fs\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.627981    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-system-cni-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmstj\" (UniqueName: \"kubernetes.io/projected/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-kube-api-access-fmstj\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-dbus\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-modprobe-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-node-log\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e80b292-c67c-437a-a2ff-003294aa90ff-host-slash\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tk6f\" (UniqueName: \"kubernetes.io/projected/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-kube-api-access-8tk6f\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-conf\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-run\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-registration-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.629702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf747d62-8793-4599-89b4-88000c3f56e6-serviceca\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628373    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v62wl\" (UniqueName: \"kubernetes.io/projected/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-kube-api-access-v62wl\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-registration-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksg2p\" (UniqueName: \"kubernetes.io/projected/cf747d62-8793-4599-89b4-88000c3f56e6-kube-api-access-ksg2p\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-netns\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-systemd\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628517    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-modprobe-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628521    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51615f2c-dd92-4075-bf5f-56762d6a3dd5-dbus\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628548    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-node-log\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-socket-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-socket-dir-parent\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628616    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-netns\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628643    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-multus\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.630500 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628677    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-run\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628744    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-socket-dir\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628777    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-host-run-ovn-kubernetes\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628813    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-systemd\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628873    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-d\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.628956    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.629031    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:26.128994018 +0000 UTC m=+3.032056149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.628621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-var-lib-cni-multus\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629127    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xq84\" (UniqueName: \"kubernetes.io/projected/5462ff1f-52b4-493d-8424-45c974d2236c-kube-api-access-5xq84\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-tmp\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629182    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-multus-socket-dir-parent\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-k8s-cni-cncf-io\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-hostroot\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629355    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-hostroot\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.632598 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.629438    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.629486    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:26.129470924 +0000 UTC m=+3.032533054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629525    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-run-openvswitch\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629611    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4d2d242-cfe3-4627-9315-35409c07b563-host-run-k8s-cni-cncf-io\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629779    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629799    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-sysctl-conf\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.629890    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf747d62-8793-4599-89b4-88000c3f56e6-serviceca\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.631477    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a7a8ff-af65-4c3f-a1a8-05c8207b5897-agent-certs\") pod \"konnectivity-agent-l2xzf\" (UID: \"79a7a8ff-af65-4c3f-a1a8-05c8207b5897\") " pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.631689    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-tmp\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.632082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-ovn-node-metrics-cert\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.632454    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.632471    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.632483    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:25.632541    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:26.132517564 +0000 UTC m=+3.035579692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:25.634004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.633122    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cbe5751-0d50-46a0-913e-c9cb878d23d8-etc-tuned\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.634671 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.634128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mq6c\" (UniqueName: \"kubernetes.io/projected/b4d2d242-cfe3-4627-9315-35409c07b563-kube-api-access-5mq6c\") pod \"multus-mgrfz\" (UID: \"b4d2d242-cfe3-4627-9315-35409c07b563\") " pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.637055 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.637023    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbspl\" (UniqueName: \"kubernetes.io/projected/7f9e6222-07ee-44aa-b4a6-d4d36347bcd8-kube-api-access-cbspl\") pod \"aws-ebs-csi-driver-node-lvp79\" (UID: \"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.638659 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.638636    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qg8n\" (UniqueName: \"kubernetes.io/projected/4cbe5751-0d50-46a0-913e-c9cb878d23d8-kube-api-access-9qg8n\") pod \"tuned-dt5mm\" (UID: \"4cbe5751-0d50-46a0-913e-c9cb878d23d8\") " pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.640361 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.640339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xq84\" (UniqueName: \"kubernetes.io/projected/5462ff1f-52b4-493d-8424-45c974d2236c-kube-api-access-5xq84\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:25.640669 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.640642    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmstj\" (UniqueName: \"kubernetes.io/projected/fa7acdb9-6084-40e9-86fd-a5bcbeef1902-kube-api-access-fmstj\") pod \"multus-additional-cni-plugins-8hk4h\" (UID: \"fa7acdb9-6084-40e9-86fd-a5bcbeef1902\") " pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.642295 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.642273    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v62wl\" (UniqueName: \"kubernetes.io/projected/1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81-kube-api-access-v62wl\") pod \"ovnkube-node-g492b\" (UID: \"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81\") " pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.642295 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.642283    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksg2p\" (UniqueName: \"kubernetes.io/projected/cf747d62-8793-4599-89b4-88000c3f56e6-kube-api-access-ksg2p\") pod \"node-ca-p6wxt\" (UID: \"cf747d62-8793-4599-89b4-88000c3f56e6\") " pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.679658 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.679630    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:25.730413 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e80b292-c67c-437a-a2ff-003294aa90ff-iptables-alerter-script\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.730597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-hosts-file\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.730597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-tmp-dir\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.730597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64hh\" (UniqueName: \"kubernetes.io/projected/3e80b292-c67c-437a-a2ff-003294aa90ff-kube-api-access-p64hh\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.730597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e80b292-c67c-437a-a2ff-003294aa90ff-host-slash\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.730597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tk6f\" (UniqueName: \"kubernetes.io/projected/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-kube-api-access-8tk6f\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.730976 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.730952    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-tmp-dir\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.731215 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.731082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e80b292-c67c-437a-a2ff-003294aa90ff-host-slash\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.731215 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.731155    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-hosts-file\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.731526 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.731503    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e80b292-c67c-437a-a2ff-003294aa90ff-iptables-alerter-script\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.742134 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.740802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tk6f\" (UniqueName: \"kubernetes.io/projected/4081e60e-7482-4c9a-8bb0-3275d8acb4a3-kube-api-access-8tk6f\") pod \"node-resolver-jqpvs\" (UID: \"4081e60e-7482-4c9a-8bb0-3275d8acb4a3\") " pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:25.745251 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.745222    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64hh\" (UniqueName: \"kubernetes.io/projected/3e80b292-c67c-437a-a2ff-003294aa90ff-kube-api-access-p64hh\") pod \"iptables-alerter-lpwhz\" (UID: \"3e80b292-c67c-437a-a2ff-003294aa90ff\") " pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.811074 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.811043    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dt5mm"
Jul 09 13:29:25.819862 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.819837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hk4h"
Jul 09 13:29:25.829580 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.829558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79"
Jul 09 13:29:25.845307 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.845277    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6wxt"
Jul 09 13:29:25.853499 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.853471    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgrfz"
Jul 09 13:29:25.862465 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.862306    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:25.871018 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.870998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:25.880851 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.880828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpwhz"
Jul 09 13:29:25.890468 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:25.890442    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqpvs"
Jul 09 13:29:26.132909 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:26.132879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:26.133078 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:26.132940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:26.133078 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:26.132989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:26.133078 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133035    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133083    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133095    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133111    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133093    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:27.133076358 +0000 UTC m=+4.036138479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133135    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:27.133136088 +0000 UTC m=+4.036198203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:26.133222 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:26.133171    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:27.133160606 +0000 UTC m=+4.036222724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:26.558829 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:26.558713    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:24:25 +0000 UTC" deadline="2028-03-30 14:05:08.719496468 +0000 UTC"
Jul 09 13:29:26.558829 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:26.558780    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15120h35m42.160719672s"
Jul 09 13:29:26.771456 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.771428    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf747d62_8793_4599_89b4_88000c3f56e6.slice/crio-b860fd8e55f486d12d1a21cab0e8cf1934e8bdbc3defcc224304c876af11ce8e WatchSource:0}: Error finding container b860fd8e55f486d12d1a21cab0e8cf1934e8bdbc3defcc224304c876af11ce8e: Status 404 returned error can't find the container with id b860fd8e55f486d12d1a21cab0e8cf1934e8bdbc3defcc224304c876af11ce8e
Jul 09 13:29:26.773635 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.773594    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee5931c_ca0e_4d44_8c6f_de6ac1f7bf81.slice/crio-9014f8bd87e5aef54730a80eac8580a311c416679aba26fc9870154ed985d546 WatchSource:0}: Error finding container 9014f8bd87e5aef54730a80eac8580a311c416679aba26fc9870154ed985d546: Status 404 returned error can't find the container with id 9014f8bd87e5aef54730a80eac8580a311c416679aba26fc9870154ed985d546
Jul 09 13:29:26.777892 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.777862    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a7a8ff_af65_4c3f_a1a8_05c8207b5897.slice/crio-47734c976c11d6340dcc2639f31090587ed65244c65b9893317fadf01bae593f WatchSource:0}: Error finding container 47734c976c11d6340dcc2639f31090587ed65244c65b9893317fadf01bae593f: Status 404 returned error can't find the container with id 47734c976c11d6340dcc2639f31090587ed65244c65b9893317fadf01bae593f
Jul 09 13:29:26.778544 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.778471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e6222_07ee_44aa_b4a6_d4d36347bcd8.slice/crio-a741e79e6937f1e23e8d4e2b89bd1e0547a4b622e69f9949c8b33dc693297e15 WatchSource:0}: Error finding container a741e79e6937f1e23e8d4e2b89bd1e0547a4b622e69f9949c8b33dc693297e15: Status 404 returned error can't find the container with id a741e79e6937f1e23e8d4e2b89bd1e0547a4b622e69f9949c8b33dc693297e15
Jul 09 13:29:26.779930 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.779892    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d2d242_cfe3_4627_9315_35409c07b563.slice/crio-39f47d3d2f85da02cb95d55780fb92e3c2a37e18832658f1fd83a06f223e1e77 WatchSource:0}: Error finding container 39f47d3d2f85da02cb95d55780fb92e3c2a37e18832658f1fd83a06f223e1e77: Status 404 returned error can't find the container with id 39f47d3d2f85da02cb95d55780fb92e3c2a37e18832658f1fd83a06f223e1e77
Jul 09 13:29:26.781567 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.781287    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4081e60e_7482_4c9a_8bb0_3275d8acb4a3.slice/crio-bf7b7f51a1db8c5b367717adf9b48b722c1516b87c36cebb7ae59c14688f98e4 WatchSource:0}: Error finding container bf7b7f51a1db8c5b367717adf9b48b722c1516b87c36cebb7ae59c14688f98e4: Status 404 returned error can't find the container with id bf7b7f51a1db8c5b367717adf9b48b722c1516b87c36cebb7ae59c14688f98e4
Jul 09 13:29:26.782807 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.782761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e80b292_c67c_437a_a2ff_003294aa90ff.slice/crio-6da286f9b30772826814759110badd0e0b7eb2a3607c5b3d8936cf593f210819 WatchSource:0}: Error finding container 6da286f9b30772826814759110badd0e0b7eb2a3607c5b3d8936cf593f210819: Status 404 returned error can't find the container with id 6da286f9b30772826814759110badd0e0b7eb2a3607c5b3d8936cf593f210819
Jul 09 13:29:26.783302 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.783278    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7acdb9_6084_40e9_86fd_a5bcbeef1902.slice/crio-ebdba611586f00c4bac9502ad47b277883442bfc420c57154324075810c57e74 WatchSource:0}: Error finding container ebdba611586f00c4bac9502ad47b277883442bfc420c57154324075810c57e74: Status 404 returned error can't find the container with id ebdba611586f00c4bac9502ad47b277883442bfc420c57154324075810c57e74
Jul 09 13:29:26.785103 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:26.785075    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbe5751_0d50_46a0_913e_c9cb878d23d8.slice/crio-362356b7ea2fbf14f4a1a1d2c54d2664003e8676afd17ce5cdc71dccf48eefac WatchSource:0}: Error finding container 362356b7ea2fbf14f4a1a1d2c54d2664003e8676afd17ce5cdc71dccf48eefac: Status 404 returned error can't find the container with id 362356b7ea2fbf14f4a1a1d2c54d2664003e8676afd17ce5cdc71dccf48eefac
Jul 09 13:29:27.141450 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.141235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.141487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.141514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141396    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141549    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141559    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141600    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:29.141585967 +0000 UTC m=+6.044648082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141598    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:27.141607 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141608    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:27.141908 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141656    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:29.141639554 +0000 UTC m=+6.044701669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:27.141908 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.141674    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:29.141665151 +0000 UTC m=+6.044727266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:27.559010 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.558927    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:24:25 +0000 UTC" deadline="2028-01-25 06:16:17.699397854 +0000 UTC"
Jul 09 13:29:27.559010 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.558967    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h46m50.140435653s"
Jul 09 13:29:27.660150 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.660120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:27.660326 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.660251    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:27.660678 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.660647    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:27.660769 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.660754    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:27.660830 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.660815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:27.660898 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:27.660880    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:27.683221 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.683185    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal" event={"ID":"a6791fcd4f6fea18b3ec6770f8f5ef69","Type":"ContainerStarted","Data":"3db1fea4b7091b9296b647d14e9e2d266185d41441b4e15794f6f6dc31325107"}
Jul 09 13:29:27.691126 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.691091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerStarted","Data":"ebdba611586f00c4bac9502ad47b277883442bfc420c57154324075810c57e74"}
Jul 09 13:29:27.700546 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.700336    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-38.ec2.internal" podStartSLOduration=2.700316107 podStartE2EDuration="2.700316107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:27.700238088 +0000 UTC m=+4.603300225" watchObservedRunningTime="2026-07-09 13:29:27.700316107 +0000 UTC m=+4.603378246"
Jul 09 13:29:27.708943 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.704297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqpvs" event={"ID":"4081e60e-7482-4c9a-8bb0-3275d8acb4a3","Type":"ContainerStarted","Data":"bf7b7f51a1db8c5b367717adf9b48b722c1516b87c36cebb7ae59c14688f98e4"}
Jul 09 13:29:27.708943 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.706691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgrfz" event={"ID":"b4d2d242-cfe3-4627-9315-35409c07b563","Type":"ContainerStarted","Data":"39f47d3d2f85da02cb95d55780fb92e3c2a37e18832658f1fd83a06f223e1e77"}
Jul 09 13:29:27.713597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.713549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79" event={"ID":"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8","Type":"ContainerStarted","Data":"a741e79e6937f1e23e8d4e2b89bd1e0547a4b622e69f9949c8b33dc693297e15"}
Jul 09 13:29:27.725260 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.725232    2561 generic.go:356] "Generic (PLEG): container finished" podID="f290281af5a433be33c1242706052e89" containerID="799a9bcd4ce7133c52c3b482d9da9c3f13fdb4e8e5634ef888236803a163f8a6" exitCode=0
Jul 09 13:29:27.725394 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.725315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal" event={"ID":"f290281af5a433be33c1242706052e89","Type":"ContainerDied","Data":"799a9bcd4ce7133c52c3b482d9da9c3f13fdb4e8e5634ef888236803a163f8a6"}
Jul 09 13:29:27.736812 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.736774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dt5mm" event={"ID":"4cbe5751-0d50-46a0-913e-c9cb878d23d8","Type":"ContainerStarted","Data":"362356b7ea2fbf14f4a1a1d2c54d2664003e8676afd17ce5cdc71dccf48eefac"}
Jul 09 13:29:27.763344 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.763254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpwhz" event={"ID":"3e80b292-c67c-437a-a2ff-003294aa90ff","Type":"ContainerStarted","Data":"6da286f9b30772826814759110badd0e0b7eb2a3607c5b3d8936cf593f210819"}
Jul 09 13:29:27.771120 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.770990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2xzf" event={"ID":"79a7a8ff-af65-4c3f-a1a8-05c8207b5897","Type":"ContainerStarted","Data":"47734c976c11d6340dcc2639f31090587ed65244c65b9893317fadf01bae593f"}
Jul 09 13:29:27.792281 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.792244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"9014f8bd87e5aef54730a80eac8580a311c416679aba26fc9870154ed985d546"}
Jul 09 13:29:27.815754 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:27.815666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6wxt" event={"ID":"cf747d62-8793-4599-89b4-88000c3f56e6","Type":"ContainerStarted","Data":"b860fd8e55f486d12d1a21cab0e8cf1934e8bdbc3defcc224304c876af11ce8e"}
Jul 09 13:29:28.852069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:28.851986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal" event={"ID":"f290281af5a433be33c1242706052e89","Type":"ContainerStarted","Data":"4675b4a13bd8b653bebcc9c8160edd2e65896f4db0653a888b6ca704b1b4099d"}
Jul 09 13:29:29.157283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.157242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:29.157469 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.157305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:29.157469 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.157348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:29.157581 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.157569    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:29.157637 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.157632    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:33.157613527 +0000 UTC m=+10.060675654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:29.158055 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158036    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:29.158144 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158089    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:33.158074921 +0000 UTC m=+10.061137040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:29.158213 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158167    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:29.158213 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158180    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:29.158213 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158194    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:29.158360 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.158229    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:33.158218735 +0000 UTC m=+10.061280851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:29.660086 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.660054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:29.660254 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.660177    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:29.660634 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.660577    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:29.660755 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.660677    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:29.660821 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:29.660754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:29.660871 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:29.660845    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:31.658033 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:31.658001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:31.658513 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:31.658142    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:31.658513 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:31.658249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:31.658513 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:31.658364    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:31.658513 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:31.658414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:31.658513 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:31.658484    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:33.191650 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.191555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:33.191650 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.191641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.191682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191765    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191791    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191855    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:41.191836223 +0000 UTC m=+18.094898339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191793    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191889    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191960    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:41.191942046 +0000 UTC m=+18.095004183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.191792    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:33.192199 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.192000    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:41.191990016 +0000 UTC m=+18.095052134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.659055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.659155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.659185    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.659291    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:33.659344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:33.659564 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:33.659412    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:35.657998 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:35.657965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:35.658485 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:35.657983    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:35.658485 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:35.658107    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:35.658485 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:35.658117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:35.658485 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:35.658184    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:35.658485 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:35.658254    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:37.658240 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:37.658210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:37.658686 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:37.658210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:37.658686 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:37.658322    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:37.658686 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:37.658443    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:37.658686 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:37.658210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:37.658686 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:37.658574    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:39.658654 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:39.658611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:39.659108 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:39.658611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:39.659108 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:39.658753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:39.659108 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:39.658757    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:39.659108 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:39.658859    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:39.659108 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:39.658938    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:41.255573 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.255536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.255589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.255621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255689    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255732    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255747    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255756    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255757    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255761    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:29:57.255744741 +0000 UTC m=+34.158806855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255845    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:57.255813008 +0000 UTC m=+34.158875127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:41.256005 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.255868    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:57.255855204 +0000 UTC m=+34.158917319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:41.658229 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.658205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:41.658368 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.658213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:41.658368 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:41.658313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:41.658479 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.658298    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:41.658479 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.658390    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:41.658610 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:41.658476    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:43.658562 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:43.658522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:43.659052 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:43.658635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:43.659052 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:43.658723    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:43.659052 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:43.658853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:43.659052 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:43.658856    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:43.659052 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:43.658988    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:45.658223 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.657851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:45.659035 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.657852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:45.659035 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:45.658326    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:45.659035 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.657896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:45.659035 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:45.658439    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:45.659035 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:45.658537    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:45.887269 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.887236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dt5mm" event={"ID":"4cbe5751-0d50-46a0-913e-c9cb878d23d8","Type":"ContainerStarted","Data":"76ee11bd4b91523081bcd42334bd18dca641f2cd2d1e91fbc5b841762477cefa"}
Jul 09 13:29:45.890228 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.890205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2xzf" event={"ID":"79a7a8ff-af65-4c3f-a1a8-05c8207b5897","Type":"ContainerStarted","Data":"da92f401c5a10b1cea110e4fef3dce1751be13ff962c0f2f26e4dabed6837ad6"}
Jul 09 13:29:45.892658 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.892631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"cd6be54a3c16419cc204519cd40aabc29942f194e0fd82f5ee243b4a1e8e2352"}
Jul 09 13:29:45.892759 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.892707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"1d6f439374be67a358307c836ba2f97d2b0de66aedf56ab4bd27d49adac39e64"}
Jul 09 13:29:45.892759 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.892749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"d425550c6259d0c9c5d460adc1ad51e03a4484f2f840eca5b1d737c195972251"}
Jul 09 13:29:45.892833 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.892788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"54ab799a51994d4ee92aed0106e745b8a2d4a9570ac54401dba768043655e2ff"}
Jul 09 13:29:45.892833 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.892821    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"15d69035d08cb388fee8af09355121dcaef421243e92a181739c9507f98de851"}
Jul 09 13:29:45.893984 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.893959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6wxt" event={"ID":"cf747d62-8793-4599-89b4-88000c3f56e6","Type":"ContainerStarted","Data":"0ec147bd23789392214ea920b2bacd10a1a527d7287590b49b0fd91833cea594"}
Jul 09 13:29:45.895275 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.895256    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="bc53c6dea79985f50f116bf2aa212281534dda25ce5e079c28aafff511dbe56c" exitCode=0
Jul 09 13:29:45.895359 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.895319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"bc53c6dea79985f50f116bf2aa212281534dda25ce5e079c28aafff511dbe56c"}
Jul 09 13:29:45.896794 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.896759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqpvs" event={"ID":"4081e60e-7482-4c9a-8bb0-3275d8acb4a3","Type":"ContainerStarted","Data":"654b538db7fd39a9bc41da7583568b97a16cad8d0c9aba551c1e648ea598155b"}
Jul 09 13:29:45.898121 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.898095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgrfz" event={"ID":"b4d2d242-cfe3-4627-9315-35409c07b563","Type":"ContainerStarted","Data":"6aca7c31259dda3cb752dd6114729015b9a3985d20c2fd88e6d5ce133e25c1f7"}
Jul 09 13:29:45.899482 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.899465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79" event={"ID":"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8","Type":"ContainerStarted","Data":"137d296ab57b75973c621b6ab03df4d58828ae121922b946f829e7e9cd2b2499"}
Jul 09 13:29:45.910320 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.910280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dt5mm" podStartSLOduration=4.41681332 podStartE2EDuration="22.910267129s" totalImagesPullingTime="18.493453809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:45.909844788 +0000 UTC m=+22.812906924" watchObservedRunningTime="2026-07-09 13:29:45.910267129 +0000 UTC m=+22.813329266"
Jul 09 13:29:45.910425 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.910405    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-38.ec2.internal" podStartSLOduration=20.910399358 podStartE2EDuration="20.910399358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:28.877499641 +0000 UTC m=+5.780561779" watchObservedRunningTime="2026-07-09 13:29:45.910399358 +0000 UTC m=+22.813461496"
Jul 09 13:29:45.955801 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.955764    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p6wxt" podStartSLOduration=4.452108595 podStartE2EDuration="22.955750348s" totalImagesPullingTime="18.503641753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:45.95560298 +0000 UTC m=+22.858665119" watchObservedRunningTime="2026-07-09 13:29:45.955750348 +0000 UTC m=+22.858812485"
Jul 09 13:29:45.978000 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.977954    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mgrfz" podStartSLOduration=4.426243781 podStartE2EDuration="22.977939711s" totalImagesPullingTime="18.55169593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:45.977881465 +0000 UTC m=+22.880943603" watchObservedRunningTime="2026-07-09 13:29:45.977939711 +0000 UTC m=+22.881001850"
Jul 09 13:29:45.995109 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:45.995070    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l2xzf" podStartSLOduration=12.569348213 podStartE2EDuration="22.995056243s" totalImagesPullingTime="10.42570803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:45.994504508 +0000 UTC m=+22.897566645" watchObservedRunningTime="2026-07-09 13:29:45.995056243 +0000 UTC m=+22.898118380"
Jul 09 13:29:46.903686 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:46.903652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpwhz" event={"ID":"3e80b292-c67c-437a-a2ff-003294aa90ff","Type":"ContainerStarted","Data":"436ecde8c423c31c10a45d35e98210b89686b738e11d7bf363da8665a12057d7"}
Jul 09 13:29:46.906993 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:46.906966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"c138fcae572df3e0eeff2eb3d98e189651a931b302832e5a20ae9900148560b4"}
Jul 09 13:29:46.927653 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:46.925295    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jqpvs" podStartSLOduration=5.4305951310000005 podStartE2EDuration="23.925277195s" totalImagesPullingTime="18.494682064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:46.011535694 +0000 UTC m=+22.914597830" watchObservedRunningTime="2026-07-09 13:29:46.925277195 +0000 UTC m=+23.828339335"
Jul 09 13:29:46.927653 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:46.925749    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lpwhz" podStartSLOduration=5.428740382 podStartE2EDuration="23.925737411s" totalImagesPullingTime="18.496997029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:46.924363359 +0000 UTC m=+23.827425492" watchObservedRunningTime="2026-07-09 13:29:46.925737411 +0000 UTC m=+23.828799550"
Jul 09 13:29:47.107281 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.107259    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 13:29:47.579065 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.578970    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:29:47.107276673Z","UUID":"aa1245b6-38f3-4d82-874a-d25a2578e4d1","Handler":null,"Name":"","Endpoint":""}
Jul 09 13:29:47.580640 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.580615    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 13:29:47.580770 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.580663    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 13:29:47.657706 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.657677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:47.657844 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.657725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:47.657844 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.657793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:47.657844 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:47.657808    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:47.657981 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:47.657893    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:47.658038 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:47.658005    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:47.912794 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:47.912757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79" event={"ID":"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8","Type":"ContainerStarted","Data":"94094617a2f9aedce679bece8b43bac01a5e69f98c9f16f00b374369ac7de9cc"}
Jul 09 13:29:48.177182 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.177107    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:48.177951 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.177911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:48.917408 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.917169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79" event={"ID":"7f9e6222-07ee-44aa-b4a6-d4d36347bcd8","Type":"ContainerStarted","Data":"bcc33dd4e62c52dd62c7f0044728420504b421bd649fbedd1fdd9db4d1e93561"}
Jul 09 13:29:48.921370 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.921293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"da43d47c1984015927807de47a649d4a063806aee14ae9638611b98fa40c72c6"}
Jul 09 13:29:48.921638 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.921621    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:48.922033 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.922016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l2xzf"
Jul 09 13:29:48.942406 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:48.942331    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvp79" podStartSLOduration=4.420311381 podStartE2EDuration="25.942316494s" totalImagesPullingTime="21.522005113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:48.941369141 +0000 UTC m=+25.844431279" watchObservedRunningTime="2026-07-09 13:29:48.942316494 +0000 UTC m=+25.845378631"
Jul 09 13:29:49.658467 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:49.658423    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:49.658467 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:49.658456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:49.658807 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:49.658412    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:49.658807 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:49.658566    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:49.658807 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:49.658680    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:49.659051 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:49.659003    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:51.658401 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.658376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:51.659019 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.658376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:51.659019 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:51.658495    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:51.659019 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.658506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:51.659019 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:51.658593    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:51.659019 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:51.658681    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:51.931131 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.931097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" event={"ID":"1ee5931c-ca0e-4d44-8c6f-de6ac1f7bf81","Type":"ContainerStarted","Data":"99f6961508525e586cdae2225a9272985933a62692b325617183ead8fe4f8d61"}
Jul 09 13:29:51.931381 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.931356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:51.931519 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.931419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:51.932928 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.932888    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="5b7f72fc0457ebe33baa8466fdc19f58d6b002fee96848d151c1d10d0b66306a" exitCode=0
Jul 09 13:29:51.933041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.932951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"5b7f72fc0457ebe33baa8466fdc19f58d6b002fee96848d151c1d10d0b66306a"}
Jul 09 13:29:51.946656 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.946639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:51.961189 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:51.961147    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g492b" podStartSLOduration=10.394749276 podStartE2EDuration="28.961134016s" totalImagesPullingTime="18.56638474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:51.961115132 +0000 UTC m=+28.864177292" watchObservedRunningTime="2026-07-09 13:29:51.961134016 +0000 UTC m=+28.864196136"
Jul 09 13:29:52.935415 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:52.935387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:52.949907 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:52.949883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:29:53.509634 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.509553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnqdj"]
Jul 09 13:29:53.509790 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.509673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:53.509790 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:53.509769    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:53.510267 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.510243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6nwbb"]
Jul 09 13:29:53.510370 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.510356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:53.510494 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:53.510474    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:53.511526 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.511505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kr6fg"]
Jul 09 13:29:53.511612 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.511580    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:53.511655 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:53.511640    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:53.939101 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.938911    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="72539396ed1bf6e30f7400ffdf0a67089d1fdf5269092fcfdc81458e047320cd" exitCode=0
Jul 09 13:29:53.939471 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:53.939010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"72539396ed1bf6e30f7400ffdf0a67089d1fdf5269092fcfdc81458e047320cd"}
Jul 09 13:29:54.657933 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:54.657890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:54.658106 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:54.658045    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:55.658413 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:55.658372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:55.658413 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:55.658407    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:55.659020 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:55.658517    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:55.659020 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:55.658632    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:55.945255 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:55.945185    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="bde6e6bba4f895a4cc2b1a07d003733d151ec25660cc35842fa996f09f6f5609" exitCode=0
Jul 09 13:29:55.945255 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:55.945233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"bde6e6bba4f895a4cc2b1a07d003733d151ec25660cc35842fa996f09f6f5609"}
Jul 09 13:29:56.658189 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:56.658163    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:56.658336 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:56.658282    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr6fg" podUID="ab0bf180-0b7b-4809-80ac-fc33d9adf3a6"
Jul 09 13:29:57.280289 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.280239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:57.280289 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.280279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.280309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280411    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280455    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280472    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280485    2561 projected.go:196] Error preparing data for projected volume kube-api-access-jfnt2 for pod openshift-network-diagnostics/network-check-target-kr6fg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280487    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs podName:5462ff1f-52b4-493d-8424-45c974d2236c nodeName:}" failed. No retries permitted until 2026-07-09 13:30:29.280466523 +0000 UTC m=+66.183528642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs") pod "network-metrics-daemon-6nwbb" (UID: "5462ff1f-52b4-493d-8424-45c974d2236c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280419    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280528    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2 podName:ab0bf180-0b7b-4809-80ac-fc33d9adf3a6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:29.280512156 +0000 UTC m=+66.183574274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfnt2" (UniqueName: "kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2") pod "network-check-target-kr6fg" (UID: "ab0bf180-0b7b-4809-80ac-fc33d9adf3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:57.281114 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.280581    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret podName:51615f2c-dd92-4075-bf5f-56762d6a3dd5 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:29.280548314 +0000 UTC m=+66.183610444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret") pod "global-pull-secret-syncer-cnqdj" (UID: "51615f2c-dd92-4075-bf5f-56762d6a3dd5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:57.660663 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.660633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:57.660807 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.660633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:57.660807 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.660739    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnqdj" podUID="51615f2c-dd92-4075-bf5f-56762d6a3dd5"
Jul 09 13:29:57.660879 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:57.660833    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwbb" podUID="5462ff1f-52b4-493d-8424-45c974d2236c"
Jul 09 13:29:57.860420 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.860389    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-38.ec2.internal" event="NodeReady"
Jul 09 13:29:57.860565 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.860542    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 13:29:57.909260 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.909229    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xlkbv"]
Jul 09 13:29:57.911195 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.911127    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:57.912151 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.912128    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lnrxq"]
Jul 09 13:29:57.913693 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.913669    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 13:29:57.913814 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.913767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:57.913876 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.913813    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 13:29:57.914129 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.914107    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8bp\""
Jul 09 13:29:57.916394 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.916378    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 13:29:57.916527 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.916509    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 13:29:57.916690 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.916675    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6tscd\""
Jul 09 13:29:57.916754 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.916692    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 13:29:57.921903 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.921884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlkbv"]
Jul 09 13:29:57.924514 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.924493    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnrxq"]
Jul 09 13:29:57.977013 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.976983    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:29:57.978770 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.978748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:57.981164 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.981145    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 13:29:57.981283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.981186    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 13:29:57.981520 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.981470    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 13:29:57.981520 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.981497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4rx22\""
Jul 09 13:29:57.987026 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.987005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 13:29:57.995261 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:57.995243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:29:58.084897 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.084865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085070 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.084900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085070 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.084949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085070 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-cert\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.085070 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085235 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.085235 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085235 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn4lh\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085235 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-config-volume\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.085446 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085446 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-tmp-dir\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.085446 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnm8j\" (UniqueName: \"kubernetes.io/projected/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-kube-api-access-xnm8j\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.085446 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.085446 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.085386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszgr\" (UniqueName: \"kubernetes.io/projected/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-kube-api-access-pszgr\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.186431 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-config-volume\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.186593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.186593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-tmp-dir\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.186593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnm8j\" (UniqueName: \"kubernetes.io/projected/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-kube-api-access-xnm8j\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.186803 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.186876 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszgr\" (UniqueName: \"kubernetes.io/projected/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-kube-api-access-pszgr\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.186876 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.186883    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:58.187004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.186902    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498f45c9b-h87m4: secret "image-registry-tls" not found
Jul 09 13:29:58.187004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187004 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.186885    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-config-volume\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.187004 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.186988    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls podName:74774745-98e0-4cd4-b571-8fffc62d2edc nodeName:}" failed. No retries permitted until 2026-07-09 13:29:58.686968815 +0000 UTC m=+35.590030930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls") pod "image-registry-6498f45c9b-h87m4" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc") : secret "image-registry-tls" not found
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-cert\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-tmp-dir\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn4lh\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187288 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.187255    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:58.187667 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.187318    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls podName:6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:58.687300307 +0000 UTC m=+35.590362422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls") pod "dns-default-xlkbv" (UID: "6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:58.187667 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187457    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187667 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187508    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.187815 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.187653    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.191583 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.191559    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.191730 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.191601    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.191730 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.191669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-cert\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.198951 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.197114    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.199702 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.199535    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnm8j\" (UniqueName: \"kubernetes.io/projected/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-kube-api-access-xnm8j\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.200548 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.200523    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn4lh\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.201680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.201651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszgr\" (UniqueName: \"kubernetes.io/projected/cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad-kube-api-access-pszgr\") pod \"ingress-canary-lnrxq\" (UID: \"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad\") " pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.228322 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.228301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnrxq"
Jul 09 13:29:58.375351 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.375082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnrxq"]
Jul 09 13:29:58.380171 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:29:58.380139    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1a6d5d_eddb_4f5e_b53d_12fc2c7a53ad.slice/crio-3003d5cceb0dd85cfb2e1a1d2309ebf136a4b966c5691eff1e4e0165e71ff0cd WatchSource:0}: Error finding container 3003d5cceb0dd85cfb2e1a1d2309ebf136a4b966c5691eff1e4e0165e71ff0cd: Status 404 returned error can't find the container with id 3003d5cceb0dd85cfb2e1a1d2309ebf136a4b966c5691eff1e4e0165e71ff0cd
Jul 09 13:29:58.658721 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.658691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:29:58.661403 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.661377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 13:29:58.661403 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.661395    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xg9bl\""
Jul 09 13:29:58.661654 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.661639    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 13:29:58.690943 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.690903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:58.691091 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.690979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:58.691091 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.691026    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:58.691091 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.691039    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498f45c9b-h87m4: secret "image-registry-tls" not found
Jul 09 13:29:58.691091 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.691094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls podName:74774745-98e0-4cd4-b571-8fffc62d2edc nodeName:}" failed. No retries permitted until 2026-07-09 13:29:59.691076945 +0000 UTC m=+36.594139066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls") pod "image-registry-6498f45c9b-h87m4" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc") : secret "image-registry-tls" not found
Jul 09 13:29:58.691282 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.691128    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:58.691282 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:58.691193    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls podName:6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:59.691174311 +0000 UTC m=+36.594236427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls") pod "dns-default-xlkbv" (UID: "6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:58.953113 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:58.953023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnrxq" event={"ID":"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad","Type":"ContainerStarted","Data":"3003d5cceb0dd85cfb2e1a1d2309ebf136a4b966c5691eff1e4e0165e71ff0cd"}
Jul 09 13:29:59.658079 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.658041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:29:59.658549 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.658234    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:29:59.660759 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.660555    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 13:29:59.660759 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.660650    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 13:29:59.660992 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.660880    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhp6\""
Jul 09 13:29:59.698143 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.698115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:29:59.698296 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:29:59.698179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:29:59.698296 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:59.698285    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:59.698376 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:59.698309    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498f45c9b-h87m4: secret "image-registry-tls" not found
Jul 09 13:29:59.698376 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:59.698366    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls podName:74774745-98e0-4cd4-b571-8fffc62d2edc nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.6983469 +0000 UTC m=+38.601409026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls") pod "image-registry-6498f45c9b-h87m4" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc") : secret "image-registry-tls" not found
Jul 09 13:29:59.698479 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:59.698289    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:59.698479 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:29:59.698436    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls podName:6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.698418187 +0000 UTC m=+38.601480304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls") pod "dns-default-xlkbv" (UID: "6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55") : secret "dns-default-metrics-tls" not found
Jul 09 13:30:00.278933 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.278887    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"]
Jul 09 13:30:00.300618 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.300586    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-glqs9"]
Jul 09 13:30:00.300777 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.300721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"
Jul 09 13:30:00.303799 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.303770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7895n\""
Jul 09 13:30:00.304687 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.304665    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 13:30:00.308734 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.308713    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 13:30:00.316457 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.316428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.317564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.317523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"]
Jul 09 13:30:00.325760 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.325721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glqs9"]
Jul 09 13:30:00.325869 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.325798    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kc8dw\""
Jul 09 13:30:00.325869 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.325834    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 13:30:00.326024 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.325869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 13:30:00.326024 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.325872    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 13:30:00.326024 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.326003    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 13:30:00.404123 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70e09dc8-2041-40a5-8610-7ed472e3a9e6-crio-socket\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.404123 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70e09dc8-2041-40a5-8610-7ed472e3a9e6-data-volume\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.404305 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.404305 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqw79\" (UniqueName: \"kubernetes.io/projected/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-api-access-zqw79\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.404305 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.404305 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.404301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58bm\" (UniqueName: \"kubernetes.io/projected/f1250926-d1b6-4466-a474-50c76eb07122-kube-api-access-q58bm\") pod \"migrator-d57d58cc9-sf2t4\" (UID: \"f1250926-d1b6-4466-a474-50c76eb07122\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"
Jul 09 13:30:00.505443 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70e09dc8-2041-40a5-8610-7ed472e3a9e6-crio-socket\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505586 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70e09dc8-2041-40a5-8610-7ed472e3a9e6-data-volume\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505586 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505586 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqw79\" (UniqueName: \"kubernetes.io/projected/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-api-access-zqw79\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:00.505638    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505665    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70e09dc8-2041-40a5-8610-7ed472e3a9e6-crio-socket\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58bm\" (UniqueName: \"kubernetes.io/projected/f1250926-d1b6-4466-a474-50c76eb07122-kube-api-access-q58bm\") pod \"migrator-d57d58cc9-sf2t4\" (UID: \"f1250926-d1b6-4466-a474-50c76eb07122\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:00.505719    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.00569802 +0000 UTC m=+37.908760174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:00.505761 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:00.505732    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.506072 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:00.505791    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.005769604 +0000 UTC m=+37.908831726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.506072 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.505859    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70e09dc8-2041-40a5-8610-7ed472e3a9e6-data-volume\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.524576 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.524547    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58bm\" (UniqueName: \"kubernetes.io/projected/f1250926-d1b6-4466-a474-50c76eb07122-kube-api-access-q58bm\") pod \"migrator-d57d58cc9-sf2t4\" (UID: \"f1250926-d1b6-4466-a474-50c76eb07122\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"
Jul 09 13:30:00.527350 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.527326    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqw79\" (UniqueName: \"kubernetes.io/projected/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-api-access-zqw79\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:00.610799 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:00.610726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"
Jul 09 13:30:01.010539 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.010500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:01.011017 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.010570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:01.011017 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.010665    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:01.011017 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.010748    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:02.010727736 +0000 UTC m=+38.913789851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:01.011017 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.010749    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:01.011017 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.010793    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:02.010780224 +0000 UTC m=+38.913842343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:01.619964 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.619702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4"]
Jul 09 13:30:01.623183 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.623161    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqpvs_4081e60e-7482-4c9a-8bb0-3275d8acb4a3/dns-node-resolver/0.log"
Jul 09 13:30:01.624144 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:01.624107    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1250926_d1b6_4466_a474_50c76eb07122.slice/crio-6217c1661f90c9a47976ba50a962be219f4cd7feb3e735945075eb7bc857ea04 WatchSource:0}: Error finding container 6217c1661f90c9a47976ba50a962be219f4cd7feb3e735945075eb7bc857ea04: Status 404 returned error can't find the container with id 6217c1661f90c9a47976ba50a962be219f4cd7feb3e735945075eb7bc857ea04
Jul 09 13:30:01.715134 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.715076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:01.715134 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.715127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:01.715372 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.715217    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:30:01.715372 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.715268    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls podName:6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:05.715250792 +0000 UTC m=+42.618312907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls") pod "dns-default-xlkbv" (UID: "6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55") : secret "dns-default-metrics-tls" not found
Jul 09 13:30:01.715372 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.715266    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:30:01.715372 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.715292    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498f45c9b-h87m4: secret "image-registry-tls" not found
Jul 09 13:30:01.715372 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:01.715355    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls podName:74774745-98e0-4cd4-b571-8fffc62d2edc nodeName:}" failed. No retries permitted until 2026-07-09 13:30:05.715333205 +0000 UTC m=+42.618395324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls") pod "image-registry-6498f45c9b-h87m4" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc") : secret "image-registry-tls" not found
Jul 09 13:30:01.963833 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.963800    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="05e12bc69d2d7c26752b86feda2d9dbcaae5ff6b338dbdbe63e4b94e7eb61c56" exitCode=0
Jul 09 13:30:01.964011 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.963872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"05e12bc69d2d7c26752b86feda2d9dbcaae5ff6b338dbdbe63e4b94e7eb61c56"}
Jul 09 13:30:01.965455 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.965394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnrxq" event={"ID":"cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad","Type":"ContainerStarted","Data":"3a319f98c2994f1c2e58ff4f7a6bf50a07fb7701832f769f8ba2c6433036f60c"}
Jul 09 13:30:01.966433 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:01.966408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4" event={"ID":"f1250926-d1b6-4466-a474-50c76eb07122","Type":"ContainerStarted","Data":"6217c1661f90c9a47976ba50a962be219f4cd7feb3e735945075eb7bc857ea04"}
Jul 09 13:30:02.006155 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.006099    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lnrxq" podStartSLOduration=1.923021901 podStartE2EDuration="5.006079237s" totalImagesPullingTime="3.083057336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:02.005781432 +0000 UTC m=+38.908843569" watchObservedRunningTime="2026-07-09 13:30:02.006079237 +0000 UTC m=+38.909141379"
Jul 09 13:30:02.018359 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.018118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:02.018359 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.018180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:02.018359 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:02.018326    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:02.019143 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:02.018381    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.01836381 +0000 UTC m=+40.921425924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:02.019143 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:02.018644    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:02.019143 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:02.018696    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.018679878 +0000 UTC m=+40.921742006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:02.430809 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.430780    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wjs44"]
Jul 09 13:30:02.435912 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.435894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.438468 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.438443    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 13:30:02.438591 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.438442    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 13:30:02.438728 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.438712    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5ffhp\""
Jul 09 13:30:02.438796 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.438749    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 13:30:02.438852 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.438798    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 13:30:02.443274 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.443255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wjs44"]
Jul 09 13:30:02.623911 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.623870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-key\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.624083 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.623936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-cabundle\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.624083 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.624009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xbr\" (UniqueName: \"kubernetes.io/projected/1a22502d-76b7-45a1-aa62-49bfc5a173e0-kube-api-access-k4xbr\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.725259 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.725181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-key\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.725402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.725297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-cabundle\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.725402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.725343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xbr\" (UniqueName: \"kubernetes.io/projected/1a22502d-76b7-45a1-aa62-49bfc5a173e0-kube-api-access-k4xbr\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.726085 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.726061    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-cabundle\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.729701 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.729678    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a22502d-76b7-45a1-aa62-49bfc5a173e0-signing-key\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.737269 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.737249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xbr\" (UniqueName: \"kubernetes.io/projected/1a22502d-76b7-45a1-aa62-49bfc5a173e0-kube-api-access-k4xbr\") pod \"service-ca-758f599c5-wjs44\" (UID: \"1a22502d-76b7-45a1-aa62-49bfc5a173e0\") " pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.745681 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.745655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wjs44"
Jul 09 13:30:02.881912 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.881685    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wjs44"]
Jul 09 13:30:02.972863 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.972826    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa7acdb9-6084-40e9-86fd-a5bcbeef1902" containerID="91b3bf8b0b9b105c1ce4faa5826df08f359d24d308bcb4d264360f56c27750a6" exitCode=0
Jul 09 13:30:02.973037 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:02.972953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerDied","Data":"91b3bf8b0b9b105c1ce4faa5826df08f359d24d308bcb4d264360f56c27750a6"}
Jul 09 13:30:03.022094 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.021987    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6wxt_cf747d62-8793-4599-89b4-88000c3f56e6/node-ca/0.log"
Jul 09 13:30:03.148252 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:03.148223    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a22502d_76b7_45a1_aa62_49bfc5a173e0.slice/crio-b15a2f1abbc4b2315b4c2b2b6f8e94f87844c1ab031211fe79b2462be0f80031 WatchSource:0}: Error finding container b15a2f1abbc4b2315b4c2b2b6f8e94f87844c1ab031211fe79b2462be0f80031: Status 404 returned error can't find the container with id b15a2f1abbc4b2315b4c2b2b6f8e94f87844c1ab031211fe79b2462be0f80031
Jul 09 13:30:03.422629 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.422603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnrxq_cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad/serve-healthcheck-canary/0.log"
Jul 09 13:30:03.978413 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.978377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4" event={"ID":"f1250926-d1b6-4466-a474-50c76eb07122","Type":"ContainerStarted","Data":"6c8cc12b7fc8244ea72001d58599909c1445e71ac1596044b301a0fcb35c3d76"}
Jul 09 13:30:03.978583 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.978441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4" event={"ID":"f1250926-d1b6-4466-a474-50c76eb07122","Type":"ContainerStarted","Data":"4670469fa195028223e093d116540b10551c76d3818457752d28cb08a34cdd1f"}
Jul 09 13:30:03.979729 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.979698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wjs44" event={"ID":"1a22502d-76b7-45a1-aa62-49bfc5a173e0","Type":"ContainerStarted","Data":"b15a2f1abbc4b2315b4c2b2b6f8e94f87844c1ab031211fe79b2462be0f80031"}
Jul 09 13:30:03.983932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.983888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" event={"ID":"fa7acdb9-6084-40e9-86fd-a5bcbeef1902","Type":"ContainerStarted","Data":"af04cab8fc3a2802844c37de29cd05edd35bf7c76282477d3fcddf9a5dea9e6e"}
Jul 09 13:30:03.995718 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:03.995662    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-sf2t4" podStartSLOduration=2.18918971 podStartE2EDuration="3.995642911s" totalImagesPullingTime="1.806453201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:03.994433102 +0000 UTC m=+40.897495242" watchObservedRunningTime="2026-07-09 13:30:03.995642911 +0000 UTC m=+40.898705048"
Jul 09 13:30:04.018694 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:04.018642    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8hk4h" podStartSLOduration=9.234901354 podStartE2EDuration="41.018624239s" totalImagesPullingTime="31.783722885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:04.017369324 +0000 UTC m=+40.920431463" watchObservedRunningTime="2026-07-09 13:30:04.018624239 +0000 UTC m=+40.921686375"
Jul 09 13:30:04.038110 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:04.038079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:04.038566 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:04.038125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:04.038566 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:04.038252    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:04.038566 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:04.038294    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:04.038566 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:04.038310    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:08.038291729 +0000 UTC m=+44.941353847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:04.038566 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:04.038333    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:08.03832343 +0000 UTC m=+44.941385548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:05.751597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:05.751561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:05.751672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:05.751729    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:05.751802    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:05.751811    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls podName:6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:13.751794037 +0000 UTC m=+50.654856156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls") pod "dns-default-xlkbv" (UID: "6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55") : secret "dns-default-metrics-tls" not found
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:05.751815    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498f45c9b-h87m4: secret "image-registry-tls" not found
Jul 09 13:30:05.751974 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:05.751867    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls podName:74774745-98e0-4cd4-b571-8fffc62d2edc nodeName:}" failed. No retries permitted until 2026-07-09 13:30:13.75185222 +0000 UTC m=+50.654914353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls") pod "image-registry-6498f45c9b-h87m4" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc") : secret "image-registry-tls" not found
Jul 09 13:30:06.993204 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:06.993166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wjs44" event={"ID":"1a22502d-76b7-45a1-aa62-49bfc5a173e0","Type":"ContainerStarted","Data":"ed7f41718012f17aca8e3fe952f1be1e0fcbbd03f7e67dab3f6ddf11b9925ee2"}
Jul 09 13:30:07.012793 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:07.012737    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-wjs44" podStartSLOduration=2.129132926 podStartE2EDuration="5.012707527s" totalImagesPullingTime="2.883574601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:07.012021336 +0000 UTC m=+43.915083476" watchObservedRunningTime="2026-07-09 13:30:07.012707527 +0000 UTC m=+43.915769668"
Jul 09 13:30:08.069209 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:08.069169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:08.069588 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:08.069231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:08.069588 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:08.069392    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:08.069588 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:08.069457    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls podName:70e09dc8-2041-40a5-8610-7ed472e3a9e6 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:16.069442492 +0000 UTC m=+52.972504607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glqs9" (UID: "70e09dc8-2041-40a5-8610-7ed472e3a9e6") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:08.069726 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:08.069708    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70e09dc8-2041-40a5-8610-7ed472e3a9e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:13.811808 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.811769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:13.812273 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.811899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:13.815148 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.815115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55-metrics-tls\") pod \"dns-default-xlkbv\" (UID: \"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55\") " pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:13.815272 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.815204    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"image-registry-6498f45c9b-h87m4\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") " pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:13.822050 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.822029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:13.890355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.890118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:13.978356 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:13.978329    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlkbv"]
Jul 09 13:30:13.981495 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:13.981468    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2e08ad_cc3c_4b2f_8e56_1c71c8807b55.slice/crio-de3286beae5e1feefe72127db77659c51c9ce29c6b3f33f3e7d0f4910beb26f8 WatchSource:0}: Error finding container de3286beae5e1feefe72127db77659c51c9ce29c6b3f33f3e7d0f4910beb26f8: Status 404 returned error can't find the container with id de3286beae5e1feefe72127db77659c51c9ce29c6b3f33f3e7d0f4910beb26f8
Jul 09 13:30:14.014055 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:14.014024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlkbv" event={"ID":"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55","Type":"ContainerStarted","Data":"de3286beae5e1feefe72127db77659c51c9ce29c6b3f33f3e7d0f4910beb26f8"}
Jul 09 13:30:14.045981 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:14.045954    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:30:14.049246 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:14.049219    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74774745_98e0_4cd4_b571_8fffc62d2edc.slice/crio-31207ed72e7c9fda698f6ad01f914a5bb379d08fda6e073ed8b7aafe34d76539 WatchSource:0}: Error finding container 31207ed72e7c9fda698f6ad01f914a5bb379d08fda6e073ed8b7aafe34d76539: Status 404 returned error can't find the container with id 31207ed72e7c9fda698f6ad01f914a5bb379d08fda6e073ed8b7aafe34d76539
Jul 09 13:30:15.019040 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:15.019002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" event={"ID":"74774745-98e0-4cd4-b571-8fffc62d2edc","Type":"ContainerStarted","Data":"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"}
Jul 09 13:30:15.019477 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:15.019062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" event={"ID":"74774745-98e0-4cd4-b571-8fffc62d2edc","Type":"ContainerStarted","Data":"31207ed72e7c9fda698f6ad01f914a5bb379d08fda6e073ed8b7aafe34d76539"}
Jul 09 13:30:15.019477 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:15.019206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:15.045559 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:15.045509    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" podStartSLOduration=18.045493511 podStartE2EDuration="18.045493511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:15.04480028 +0000 UTC m=+51.947862418" watchObservedRunningTime="2026-07-09 13:30:15.045493511 +0000 UTC m=+51.948555625"
Jul 09 13:30:16.129560 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:16.129527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:16.131838 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:16.131809    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70e09dc8-2041-40a5-8610-7ed472e3a9e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glqs9\" (UID: \"70e09dc8-2041-40a5-8610-7ed472e3a9e6\") " pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:16.227119 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:16.227092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glqs9"
Jul 09 13:30:16.399525 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:16.399493    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glqs9"]
Jul 09 13:30:16.403575 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:16.403550    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e09dc8_2041_40a5_8610_7ed472e3a9e6.slice/crio-cf0b1cecb6723c6d6cc15852ca837f636022d5bd9ae924d603a7b222c84409b0 WatchSource:0}: Error finding container cf0b1cecb6723c6d6cc15852ca837f636022d5bd9ae924d603a7b222c84409b0: Status 404 returned error can't find the container with id cf0b1cecb6723c6d6cc15852ca837f636022d5bd9ae924d603a7b222c84409b0
Jul 09 13:30:17.028160 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:17.028118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlkbv" event={"ID":"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55","Type":"ContainerStarted","Data":"ce6df7bddc023552d1efe39ac12b4af58967ee1a77f02a6f2d04d93194b9b650"}
Jul 09 13:30:17.028326 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:17.028184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlkbv" event={"ID":"6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55","Type":"ContainerStarted","Data":"ea2d5b057b59060f65a6fec1288805928bf69161ac347762c16ffd55eafb3d42"}
Jul 09 13:30:17.028326 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:17.028308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:17.029593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:17.029527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glqs9" event={"ID":"70e09dc8-2041-40a5-8610-7ed472e3a9e6","Type":"ContainerStarted","Data":"cf0b1cecb6723c6d6cc15852ca837f636022d5bd9ae924d603a7b222c84409b0"}
Jul 09 13:30:17.066407 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:17.065875    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xlkbv" podStartSLOduration=17.776863481 podStartE2EDuration="20.065855004s" totalImagesPullingTime="2.288991523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:17.065439837 +0000 UTC m=+53.968501975" watchObservedRunningTime="2026-07-09 13:30:17.065855004 +0000 UTC m=+53.968917143"
Jul 09 13:30:21.044271 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.044238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glqs9" event={"ID":"70e09dc8-2041-40a5-8610-7ed472e3a9e6","Type":"ContainerStarted","Data":"9566e30a9c7b60885b6e2e551ac9a876094b8b565f98342acb5e095cb925b94f"}
Jul 09 13:30:21.044593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.044323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glqs9" event={"ID":"70e09dc8-2041-40a5-8610-7ed472e3a9e6","Type":"ContainerStarted","Data":"6d1ae163a0cca5c6d32e006135d94e7fb2cf19c915d20b0f273040d935358293"}
Jul 09 13:30:21.465423 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.465392    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"]
Jul 09 13:30:21.467594 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.467566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.468553 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.468528    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"]
Jul 09 13:30:21.470478 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.470460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 13:30:21.470796 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.470776    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"]
Jul 09 13:30:21.470888 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.470809    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j8hf5\""
Jul 09 13:30:21.470961 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.470888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.471029 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.471005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 13:30:21.472892 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.472877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.474194 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.474174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 13:30:21.474272 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.474234    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 13:30:21.474272 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.474241    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 13:30:21.474538 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.474522    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 13:30:21.474592 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.474552    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bwp5l\""
Jul 09 13:30:21.475163 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.475149    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 13:30:21.475345 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.475332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 13:30:21.475561 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.475550    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 13:30:21.475693 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.475681    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 13:30:21.479895 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.479874    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"]
Jul 09 13:30:21.487737 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.487713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"]
Jul 09 13:30:21.488482 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.488457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"]
Jul 09 13:30:21.534774 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.534749    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:30:21.571756 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c454f18-d674-41b0-99d5-903d5e26f151-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.571883 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57zqx\" (UniqueName: \"kubernetes.io/projected/02d7ca8e-2b52-4de4-9bcf-274963007ebf-kube-api-access-57zqx\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.571883 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.571883 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67becda-a52f-47cb-8e4a-0a8be9851709-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.572041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.572041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c454f18-d674-41b0-99d5-903d5e26f151-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.572041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.571955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdq5\" (UniqueName: \"kubernetes.io/projected/f67becda-a52f-47cb-8e4a-0a8be9851709-kube-api-access-frdq5\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.572041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.572006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.572041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.572028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02d7ca8e-2b52-4de4-9bcf-274963007ebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.572194 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.572061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.573929 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.573895    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"]
Jul 09 13:30:21.575868 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.575855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.603042 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.603019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"]
Jul 09 13:30:21.673019 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.672993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c454f18-d674-41b0-99d5-903d5e26f151-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.673158 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57zqx\" (UniqueName: \"kubernetes.io/projected/02d7ca8e-2b52-4de4-9bcf-274963007ebf-kube-api-access-57zqx\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.673229 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-image-registry-private-configuration\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.673229 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.673229 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-installation-pull-secrets\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.673378 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-tls\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.673378 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67becda-a52f-47cb-8e4a-0a8be9851709-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.673471 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-trusted-ca\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.673532 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-ca-trust-extracted\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.673532 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c454f18-d674-41b0-99d5-903d5e26f151-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frdq5\" (UniqueName: \"kubernetes.io/projected/f67becda-a52f-47cb-8e4a-0a8be9851709-kube-api-access-frdq5\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-bound-sa-token\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4kk8\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-kube-api-access-z4kk8\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02d7ca8e-2b52-4de4-9bcf-274963007ebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.673744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-certificates\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.674138    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67becda-a52f-47cb-8e4a-0a8be9851709-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.674283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.674234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.674750 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.674336    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c454f18-d674-41b0-99d5-903d5e26f151-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.676266 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.676243    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c454f18-d674-41b0-99d5-903d5e26f151-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2bxsn\" (UID: \"3c454f18-d674-41b0-99d5-903d5e26f151\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.676375 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.676284    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.676375 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.676351    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.676860 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.676838    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-ca\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.676955 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.676909    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02d7ca8e-2b52-4de4-9bcf-274963007ebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.677581 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.677564    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f67becda-a52f-47cb-8e4a-0a8be9851709-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.687984 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.687960    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57zqx\" (UniqueName: \"kubernetes.io/projected/02d7ca8e-2b52-4de4-9bcf-274963007ebf-kube-api-access-57zqx\") pod \"managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5\" (UID: \"02d7ca8e-2b52-4de4-9bcf-274963007ebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.688152 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.688134    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdq5\" (UniqueName: \"kubernetes.io/projected/f67becda-a52f-47cb-8e4a-0a8be9851709-kube-api-access-frdq5\") pod \"cluster-proxy-proxy-agent-d7ff7668-jqttf\" (UID: \"f67becda-a52f-47cb-8e4a-0a8be9851709\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.775564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-image-registry-private-configuration\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775564 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-installation-pull-secrets\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775758 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-tls\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775758 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-trusted-ca\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775758 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-ca-trust-extracted\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775910 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-bound-sa-token\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775910 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4kk8\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-kube-api-access-z4kk8\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.775910 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.775880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-certificates\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.776099 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.776063    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-ca-trust-extracted\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.776743 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.776674    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-trusted-ca\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.777072 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.777040    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-certificates\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.778291 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.778266    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-registry-tls\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.778405 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.778344    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-image-registry-private-configuration\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.778541 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.778521    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-installation-pull-secrets\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.779351 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.779298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"
Jul 09 13:30:21.786311 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.786270    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-bound-sa-token\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.788244 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.788226    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4kk8\" (UniqueName: \"kubernetes.io/projected/ea2cd02c-c142-4d31-815d-035c5d3a0ff3-kube-api-access-z4kk8\") pod \"image-registry-6d6f69d4b7-hgg8w\" (UID: \"ea2cd02c-c142-4d31-815d-035c5d3a0ff3\") " pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.795199 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.795140    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"
Jul 09 13:30:21.799716 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.799696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"
Jul 09 13:30:21.900813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.900765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:21.943481 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:21.943408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn"]
Jul 09 13:30:21.948117 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:21.948074    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c454f18_d674_41b0_99d5_903d5e26f151.slice/crio-e3a00df26f68c1cfe5326906fad59980f94fd6a094d70c8035ead4a8dc1a1c5a WatchSource:0}: Error finding container e3a00df26f68c1cfe5326906fad59980f94fd6a094d70c8035ead4a8dc1a1c5a: Status 404 returned error can't find the container with id e3a00df26f68c1cfe5326906fad59980f94fd6a094d70c8035ead4a8dc1a1c5a
Jul 09 13:30:22.049263 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:22.049179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn" event={"ID":"3c454f18-d674-41b0-99d5-903d5e26f151","Type":"ContainerStarted","Data":"e3a00df26f68c1cfe5326906fad59980f94fd6a094d70c8035ead4a8dc1a1c5a"}
Jul 09 13:30:22.055350 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:22.055327    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"]
Jul 09 13:30:22.058654 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:22.058629    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2cd02c_c142_4d31_815d_035c5d3a0ff3.slice/crio-ee09e70846356507cb8e4c8775a913d2445816d15199e9eb75b53c340b7ec5d3 WatchSource:0}: Error finding container ee09e70846356507cb8e4c8775a913d2445816d15199e9eb75b53c340b7ec5d3: Status 404 returned error can't find the container with id ee09e70846356507cb8e4c8775a913d2445816d15199e9eb75b53c340b7ec5d3
Jul 09 13:30:22.170668 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:22.170635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5"]
Jul 09 13:30:22.173773 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:22.173749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf"]
Jul 09 13:30:22.173958 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:22.173930    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02d7ca8e_2b52_4de4_9bcf_274963007ebf.slice/crio-68a533bd81eadcd09f7a3f1f3a5223954ea167f7c6546c1887e5b0cf7ca344d4 WatchSource:0}: Error finding container 68a533bd81eadcd09f7a3f1f3a5223954ea167f7c6546c1887e5b0cf7ca344d4: Status 404 returned error can't find the container with id 68a533bd81eadcd09f7a3f1f3a5223954ea167f7c6546c1887e5b0cf7ca344d4
Jul 09 13:30:23.054312 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.054270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf" event={"ID":"f67becda-a52f-47cb-8e4a-0a8be9851709","Type":"ContainerStarted","Data":"3d02b0e5b8cc15ad06cec8351171272ca77b0e4b46b4acaf1b6ae706b6a7f92e"}
Jul 09 13:30:23.056110 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.056080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w" event={"ID":"ea2cd02c-c142-4d31-815d-035c5d3a0ff3","Type":"ContainerStarted","Data":"134456c2f896123e13e913e5523db3323c55dd37c82b67703c22757f993cf082"}
Jul 09 13:30:23.056310 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.056160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w" event={"ID":"ea2cd02c-c142-4d31-815d-035c5d3a0ff3","Type":"ContainerStarted","Data":"ee09e70846356507cb8e4c8775a913d2445816d15199e9eb75b53c340b7ec5d3"}
Jul 09 13:30:23.056310 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.056209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:23.057521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.057495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5" event={"ID":"02d7ca8e-2b52-4de4-9bcf-274963007ebf","Type":"ContainerStarted","Data":"68a533bd81eadcd09f7a3f1f3a5223954ea167f7c6546c1887e5b0cf7ca344d4"}
Jul 09 13:30:23.081053 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:23.081013    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w" podStartSLOduration=2.080997658 podStartE2EDuration="2.080997658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:23.079203592 +0000 UTC m=+59.982265733" watchObservedRunningTime="2026-07-09 13:30:23.080997658 +0000 UTC m=+59.984059796"
Jul 09 13:30:24.952618 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:24.952583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g492b"
Jul 09 13:30:25.067152 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:25.067113    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glqs9" event={"ID":"70e09dc8-2041-40a5-8610-7ed472e3a9e6","Type":"ContainerStarted","Data":"2d559163193e0ac45511c2309480ba1ad17e83212580e7ccbaddc5dbb66013e8"}
Jul 09 13:30:25.068620 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:25.068596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn" event={"ID":"3c454f18-d674-41b0-99d5-903d5e26f151","Type":"ContainerStarted","Data":"e6a7151cb724743ab113d72614500a471cdfd8984ec495e666b2ffaaad19f8bf"}
Jul 09 13:30:25.093498 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:25.093450    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-glqs9" podStartSLOduration=17.207217628 podStartE2EDuration="25.093434981s" totalImagesPullingTime="7.886217353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:30:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:25.093090324 +0000 UTC m=+61.996152462" watchObservedRunningTime="2026-07-09 13:30:25.093434981 +0000 UTC m=+61.996497118"
Jul 09 13:30:27.035547 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:27.035516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xlkbv"
Jul 09 13:30:27.067090 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:27.067038    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2bxsn" podStartSLOduration=3.623303342 podStartE2EDuration="6.067021284s" totalImagesPullingTime="2.443717942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:25.10911224 +0000 UTC m=+62.012174381" watchObservedRunningTime="2026-07-09 13:30:27.067021284 +0000 UTC m=+63.970083431"
Jul 09 13:30:27.078368 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:27.078335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5" event={"ID":"02d7ca8e-2b52-4de4-9bcf-274963007ebf","Type":"ContainerStarted","Data":"283b681b7f070907e51525ec4cbee193ac8a5cf22ab8d806b6d757a3c8419303"}
Jul 09 13:30:27.107408 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:27.107347    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b9cbdbbd-fvsc5" podStartSLOduration=2.208486005 podStartE2EDuration="6.10732226s" totalImagesPullingTime="3.898836255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:27.1048627 +0000 UTC m=+64.007924838" watchObservedRunningTime="2026-07-09 13:30:27.10732226 +0000 UTC m=+64.010384397"
Jul 09 13:30:29.089154 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.089063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf" event={"ID":"f67becda-a52f-47cb-8e4a-0a8be9851709","Type":"ContainerStarted","Data":"1292bc39da5879ee52e739c5cd0f2b1293a1b3bf1ed2d8d720ab0eb056db95ff"}
Jul 09 13:30:29.089154 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.089111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf" event={"ID":"f67becda-a52f-47cb-8e4a-0a8be9851709","Type":"ContainerStarted","Data":"f3a0806d65a3a0d39cc956c1f550c67fc0edbf4d920df146aef39cff823be1c5"}
Jul 09 13:30:29.089154 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.089129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf" event={"ID":"f67becda-a52f-47cb-8e4a-0a8be9851709","Type":"ContainerStarted","Data":"aaa1ddecbae3b59d38d388a7b4c14e5f81686e2cc8f85c8a4aff45ac530ac351"}
Jul 09 13:30:29.114965 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.114904    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7ff7668-jqttf" podStartSLOduration=1.567279297 podStartE2EDuration="8.114889405s" totalImagesPullingTime="6.547610108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:29.113388521 +0000 UTC m=+66.016450658" watchObservedRunningTime="2026-07-09 13:30:29.114889405 +0000 UTC m=+66.017951594"
Jul 09 13:30:29.339327 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.339221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:30:29.339327 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.339284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:30:29.339327 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.339320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:30:29.342132 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.342102    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 13:30:29.342249 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.342207    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 13:30:29.342569 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.342554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 13:30:29.352179 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.352148    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5462ff1f-52b4-493d-8424-45c974d2236c-metrics-certs\") pod \"network-metrics-daemon-6nwbb\" (UID: \"5462ff1f-52b4-493d-8424-45c974d2236c\") " pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:30:29.352179 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.352172    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51615f2c-dd92-4075-bf5f-56762d6a3dd5-original-pull-secret\") pod \"global-pull-secret-syncer-cnqdj\" (UID: \"51615f2c-dd92-4075-bf5f-56762d6a3dd5\") " pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:30:29.353205 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.353192    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 13:30:29.362517 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.362495    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnt2\" (UniqueName: \"kubernetes.io/projected/ab0bf180-0b7b-4809-80ac-fc33d9adf3a6-kube-api-access-jfnt2\") pod \"network-check-target-kr6fg\" (UID: \"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6\") " pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:30:29.374116 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.374099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhp6\""
Jul 09 13:30:29.378970 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.378958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnqdj"
Jul 09 13:30:29.382044 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.382029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwbb"
Jul 09 13:30:29.541387 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.541335    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnqdj"]
Jul 09 13:30:29.544799 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:29.544771    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51615f2c_dd92_4075_bf5f_56762d6a3dd5.slice/crio-8cf7575fe8a2e8d75dbfea90d48c534618358f5d654d92e19747591b8dc032bc WatchSource:0}: Error finding container 8cf7575fe8a2e8d75dbfea90d48c534618358f5d654d92e19747591b8dc032bc: Status 404 returned error can't find the container with id 8cf7575fe8a2e8d75dbfea90d48c534618358f5d654d92e19747591b8dc032bc
Jul 09 13:30:29.561099 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.561073    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6nwbb"]
Jul 09 13:30:29.564121 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:29.564096    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5462ff1f_52b4_493d_8424_45c974d2236c.slice/crio-130ec296dbff0979899eeec393d4d5f97cdfa186f33c662f5205a58943d00411 WatchSource:0}: Error finding container 130ec296dbff0979899eeec393d4d5f97cdfa186f33c662f5205a58943d00411: Status 404 returned error can't find the container with id 130ec296dbff0979899eeec393d4d5f97cdfa186f33c662f5205a58943d00411
Jul 09 13:30:29.571942 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.571896    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xg9bl\""
Jul 09 13:30:29.580201 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.580150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:30:29.705606 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:29.705577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kr6fg"]
Jul 09 13:30:29.708267 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:29.708237    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0bf180_0b7b_4809_80ac_fc33d9adf3a6.slice/crio-4eb6ef32d5f9073425026a8eb858db91e78f9b663ed1639a4205ec88b7cd228a WatchSource:0}: Error finding container 4eb6ef32d5f9073425026a8eb858db91e78f9b663ed1639a4205ec88b7cd228a: Status 404 returned error can't find the container with id 4eb6ef32d5f9073425026a8eb858db91e78f9b663ed1639a4205ec88b7cd228a
Jul 09 13:30:30.093947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:30.093897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cnqdj" event={"ID":"51615f2c-dd92-4075-bf5f-56762d6a3dd5","Type":"ContainerStarted","Data":"8cf7575fe8a2e8d75dbfea90d48c534618358f5d654d92e19747591b8dc032bc"}
Jul 09 13:30:30.095660 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:30.095577    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kr6fg" event={"ID":"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6","Type":"ContainerStarted","Data":"4eb6ef32d5f9073425026a8eb858db91e78f9b663ed1639a4205ec88b7cd228a"}
Jul 09 13:30:30.097566 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:30.097439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwbb" event={"ID":"5462ff1f-52b4-493d-8424-45c974d2236c","Type":"ContainerStarted","Data":"130ec296dbff0979899eeec393d4d5f97cdfa186f33c662f5205a58943d00411"}
Jul 09 13:30:31.541634 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:31.541550    2561 patch_prober.go:28] interesting pod/image-registry-6498f45c9b-h87m4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 13:30:31.542059 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:31.541614    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 13:30:32.109076 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:32.109035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwbb" event={"ID":"5462ff1f-52b4-493d-8424-45c974d2236c","Type":"ContainerStarted","Data":"96fd2b20fac6e49d344c0759216f3a6ec2415e7b0b9fb1720eb0bf722f85f814"}
Jul 09 13:30:32.109259 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:32.109104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwbb" event={"ID":"5462ff1f-52b4-493d-8424-45c974d2236c","Type":"ContainerStarted","Data":"2b6704fb6eb819b71b52fd39b7cfad80b9683f449953b30d80d2581cd85a0ad9"}
Jul 09 13:30:32.130808 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:32.130743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6nwbb" podStartSLOduration=67.69784605 podStartE2EDuration="1m9.130721112s" totalImagesPullingTime="1.432875062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.130517719 +0000 UTC m=+69.033579856" watchObservedRunningTime="2026-07-09 13:30:32.130721112 +0000 UTC m=+69.033783257"
Jul 09 13:30:35.123006 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:35.122966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kr6fg" event={"ID":"ab0bf180-0b7b-4809-80ac-fc33d9adf3a6","Type":"ContainerStarted","Data":"28d27fdb77ba0e3593eb68f9f1bf99b6c8bcf5ee2e8b21f4e57efac43e3cb1d7"}
Jul 09 13:30:35.123512 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:35.123132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:30:35.124480 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:35.124457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cnqdj" event={"ID":"51615f2c-dd92-4075-bf5f-56762d6a3dd5","Type":"ContainerStarted","Data":"b3759a0c4fc62576581e651892fe5d18ed03de12be118d197340609eb9663cb3"}
Jul 09 13:30:35.141836 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:35.141794    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kr6fg" podStartSLOduration=67.203856067 podStartE2EDuration="1m12.1417786s" totalImagesPullingTime="4.937922533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:35.140941792 +0000 UTC m=+72.044003931" watchObservedRunningTime="2026-07-09 13:30:35.1417786 +0000 UTC m=+72.044840737"
Jul 09 13:30:35.160818 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:35.160778    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cnqdj" podStartSLOduration=67.056018312 podStartE2EDuration="1m12.160767663s" totalImagesPullingTime="5.104749351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:35.160631669 +0000 UTC m=+72.063693808" watchObservedRunningTime="2026-07-09 13:30:35.160767663 +0000 UTC m=+72.063829800"
Jul 09 13:30:41.539528 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:41.539498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:42.964328 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.964287    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9cnhx"]
Jul 09 13:30:42.967371 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.967353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:42.969962 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.969935    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 13:30:42.970095 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.970043    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 13:30:42.971593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.971333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 13:30:42.971593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.971367    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 13:30:42.971593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.971372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xs29z\""
Jul 09 13:30:42.971593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.971403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 13:30:42.971593 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:42.971524    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 13:30:43.041762 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.041932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-sys\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.041932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-metrics-client-ca\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.041932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.041932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-tls\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.042135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-root\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.042135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.041957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-wtmp\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.042135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.042001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-textfile\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.042135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.042044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bmw\" (UniqueName: \"kubernetes.io/projected/6ee058d7-2b39-45e8-b109-a87f3454fc83-kube-api-access-n9bmw\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143149 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143300 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-sys\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143300 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143235    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-sys\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143300 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-metrics-client-ca\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143465 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143465 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-tls\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143465 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-root\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143616 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-wtmp\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143616 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-textfile\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143616 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bmw\" (UniqueName: \"kubernetes.io/projected/6ee058d7-2b39-45e8-b109-a87f3454fc83-kube-api-access-n9bmw\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.143812 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143787    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.144014 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143821    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ee058d7-2b39-45e8-b109-a87f3454fc83-metrics-client-ca\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.144014 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143874    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-root\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.144014 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.143969    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-wtmp\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.144182 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.144097    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-textfile\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.145956 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.145912    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-tls\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.146141 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.146122    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ee058d7-2b39-45e8-b109-a87f3454fc83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.197321 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.197295    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bmw\" (UniqueName: \"kubernetes.io/projected/6ee058d7-2b39-45e8-b109-a87f3454fc83-kube-api-access-n9bmw\") pod \"node-exporter-9cnhx\" (UID: \"6ee058d7-2b39-45e8-b109-a87f3454fc83\") " pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.277398 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:43.277328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9cnhx"
Jul 09 13:30:43.290879 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:30:43.290835    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee058d7_2b39_45e8_b109_a87f3454fc83.slice/crio-839639833cd2f5f9bb3aeec16e064298bffca1999bcf03cb044b2a4718a60bd2 WatchSource:0}: Error finding container 839639833cd2f5f9bb3aeec16e064298bffca1999bcf03cb044b2a4718a60bd2: Status 404 returned error can't find the container with id 839639833cd2f5f9bb3aeec16e064298bffca1999bcf03cb044b2a4718a60bd2
Jul 09 13:30:44.067361 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:44.067326    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d6f69d4b7-hgg8w"
Jul 09 13:30:44.158744 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:44.158689    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cnhx" event={"ID":"6ee058d7-2b39-45e8-b109-a87f3454fc83","Type":"ContainerStarted","Data":"839639833cd2f5f9bb3aeec16e064298bffca1999bcf03cb044b2a4718a60bd2"}
Jul 09 13:30:45.163992 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:45.163957    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ee058d7-2b39-45e8-b109-a87f3454fc83" containerID="d210d71a922df5102b52d7e0a7a9def2e1236fca8bffbd802ba5953f8dc6bd03" exitCode=0
Jul 09 13:30:45.164367 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:45.164001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cnhx" event={"ID":"6ee058d7-2b39-45e8-b109-a87f3454fc83","Type":"ContainerDied","Data":"d210d71a922df5102b52d7e0a7a9def2e1236fca8bffbd802ba5953f8dc6bd03"}
Jul 09 13:30:46.170298 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.170177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cnhx" event={"ID":"6ee058d7-2b39-45e8-b109-a87f3454fc83","Type":"ContainerStarted","Data":"b55a25482b884480a9b17febaf3855dc5bce2656c221159cb7e74ace70fd4a72"}
Jul 09 13:30:46.170298 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.170241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cnhx" event={"ID":"6ee058d7-2b39-45e8-b109-a87f3454fc83","Type":"ContainerStarted","Data":"6cbe2afc06715d1a95a4b46a809fc34c08cb4605566670d3f898ce73d8f62b33"}
Jul 09 13:30:46.195066 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.195020    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9cnhx" podStartSLOduration=3.188895784 podStartE2EDuration="4.195004005s" totalImagesPullingTime="941.321933ms" totalInitContainerRuntime="64.786288ms" isStatefulPod=true podCreationTimestamp="2026-07-09 13:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:46.193430859 +0000 UTC m=+83.096493020" watchObservedRunningTime="2026-07-09 13:30:46.195004005 +0000 UTC m=+83.098066141"
Jul 09 13:30:46.557362 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.557264    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerName="registry" containerID="cri-o://a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407" gracePeriod=30
Jul 09 13:30:46.798094 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.798068    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:46.872282 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872256    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn4lh\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872419 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872419 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872419 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872419 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872419 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872407    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872724 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.872724 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted\") pod \"74774745-98e0-4cd4-b571-8fffc62d2edc\" (UID: \"74774745-98e0-4cd4-b571-8fffc62d2edc\") "
Jul 09 13:30:46.873043 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.872962    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:30:46.873162 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.873101    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:30:46.874905 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.874873    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:30:46.875193 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.875101    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:30:46.875193 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.875158    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh" (OuterVolumeSpecName: "kube-api-access-rn4lh") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "kube-api-access-rn4lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:30:46.875193 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.875164    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:30:46.875332 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.875285    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:30:46.881222 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.881200    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74774745-98e0-4cd4-b571-8fffc62d2edc" (UID: "74774745-98e0-4cd4-b571-8fffc62d2edc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:30:46.973743 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973715    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74774745-98e0-4cd4-b571-8fffc62d2edc-ca-trust-extracted\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973743 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973737    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn4lh\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-kube-api-access-rn4lh\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973743 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973747    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-certificates\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973755    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-installation-pull-secrets\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973765    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74774745-98e0-4cd4-b571-8fffc62d2edc-image-registry-private-configuration\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973773    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74774745-98e0-4cd4-b571-8fffc62d2edc-trusted-ca\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973782    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-registry-tls\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:46.973947 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:46.973789    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74774745-98e0-4cd4-b571-8fffc62d2edc-bound-sa-token\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:30:47.174821 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.174736    2561 generic.go:356] "Generic (PLEG): container finished" podID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerID="a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407" exitCode=0
Jul 09 13:30:47.174821 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.174780    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4"
Jul 09 13:30:47.175282 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.174817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" event={"ID":"74774745-98e0-4cd4-b571-8fffc62d2edc","Type":"ContainerDied","Data":"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"}
Jul 09 13:30:47.175282 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.174861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498f45c9b-h87m4" event={"ID":"74774745-98e0-4cd4-b571-8fffc62d2edc","Type":"ContainerDied","Data":"31207ed72e7c9fda698f6ad01f914a5bb379d08fda6e073ed8b7aafe34d76539"}
Jul 09 13:30:47.175282 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.174895    2561 scope.go:117] "RemoveContainer" containerID="a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"
Jul 09 13:30:47.183124 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.183110    2561 scope.go:117] "RemoveContainer" containerID="a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"
Jul 09 13:30:47.183385 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:30:47.183365    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407\": container with ID starting with a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407 not found: ID does not exist" containerID="a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"
Jul 09 13:30:47.183454 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.183398    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407"} err="failed to get container status \"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407\": rpc error: code = NotFound desc = could not find container \"a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407\": container with ID starting with a0301006bc2fd8a4b5b3e8f8277cbfd8c6ee03f5753fdc28a27c3b0f37fdb407 not found: ID does not exist"
Jul 09 13:30:47.199225 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.199206    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:30:47.209680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.209657    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6498f45c9b-h87m4"]
Jul 09 13:30:47.663493 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:30:47.663458    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" path="/var/lib/kubelet/pods/74774745-98e0-4cd4-b571-8fffc62d2edc/volumes"
Jul 09 13:31:06.130429 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:31:06.130381    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kr6fg"
Jul 09 13:33:51.849049 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.848973    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"]
Jul 09 13:33:51.849534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.849193    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerName="registry"
Jul 09 13:33:51.849534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.849203    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerName="registry"
Jul 09 13:33:51.849534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.849256    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74774745-98e0-4cd4-b571-8fffc62d2edc" containerName="registry"
Jul 09 13:33:51.850930 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.850905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:51.853614 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.853585    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ts6jb\""
Jul 09 13:33:51.853614 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.853604    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 13:33:51.856599 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.856579    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 13:33:51.858116 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.858097    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 13:33:51.858116 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.858113    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 13:33:51.878705 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.878683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"]
Jul 09 13:33:51.939746 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.939719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:51.939746 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.939748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:51.939936 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.939771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:51.939936 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.939817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:51.939936 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:51.939841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw8tx\" (UniqueName: \"kubernetes.io/projected/83a7fcc3-9f33-4872-8ba0-1468086142a7-kube-api-access-kw8tx\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040210 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040210 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw8tx\" (UniqueName: \"kubernetes.io/projected/83a7fcc3-9f33-4872-8ba0-1468086142a7-kube-api-access-kw8tx\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040448 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040448 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040448 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.040733 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.040710    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.042614 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.042594    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a7fcc3-9f33-4872-8ba0-1468086142a7-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.043142 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.043122    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.043187 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.043122    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83a7fcc3-9f33-4872-8ba0-1468086142a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.050527 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.050498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw8tx\" (UniqueName: \"kubernetes.io/projected/83a7fcc3-9f33-4872-8ba0-1468086142a7-kube-api-access-kw8tx\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z\" (UID: \"83a7fcc3-9f33-4872-8ba0-1468086142a7\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.161179 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.161149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:52.297442 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.297409    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"]
Jul 09 13:33:52.300448 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:33:52.300413    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a7fcc3_9f33_4872_8ba0_1468086142a7.slice/crio-a8e84bcfe747dbeca9f65891ea23acfa41c124e60c43a7b1f2fde9987ae7a238 WatchSource:0}: Error finding container a8e84bcfe747dbeca9f65891ea23acfa41c124e60c43a7b1f2fde9987ae7a238: Status 404 returned error can't find the container with id a8e84bcfe747dbeca9f65891ea23acfa41c124e60c43a7b1f2fde9987ae7a238
Jul 09 13:33:52.794027 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:52.793992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z" event={"ID":"83a7fcc3-9f33-4872-8ba0-1468086142a7","Type":"ContainerStarted","Data":"a8e84bcfe747dbeca9f65891ea23acfa41c124e60c43a7b1f2fde9987ae7a238"}
Jul 09 13:33:55.808143 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:55.808105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z" event={"ID":"83a7fcc3-9f33-4872-8ba0-1468086142a7","Type":"ContainerStarted","Data":"ea6dd0eb5423fd1df50ff243789910cc1c4572cc2749fe1f54dfb70498bcff00"}
Jul 09 13:33:56.812597 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:56.812564    2561 generic.go:356] "Generic (PLEG): container finished" podID="83a7fcc3-9f33-4872-8ba0-1468086142a7" containerID="ea6dd0eb5423fd1df50ff243789910cc1c4572cc2749fe1f54dfb70498bcff00" exitCode=0
Jul 09 13:33:56.813110 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:56.812608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z" event={"ID":"83a7fcc3-9f33-4872-8ba0-1468086142a7","Type":"ContainerDied","Data":"ea6dd0eb5423fd1df50ff243789910cc1c4572cc2749fe1f54dfb70498bcff00"}
Jul 09 13:33:57.817624 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:57.817586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z" event={"ID":"83a7fcc3-9f33-4872-8ba0-1468086142a7","Type":"ContainerStarted","Data":"8b55cc7200bc9ab028c27132d6659968be92bbf5d2b5ecbf56e2bc7a4e23a318"}
Jul 09 13:33:57.818008 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:57.817710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:33:57.841384 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:33:57.841338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z" podStartSLOduration=2.421225683 podStartE2EDuration="6.841322194s" totalImagesPullingTime="3.409502667s" totalInitContainerRuntime="1.010593844s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:57.839321964 +0000 UTC m=+274.742384112" watchObservedRunningTime="2026-07-09 13:33:57.841322194 +0000 UTC m=+274.744384330"
Jul 09 13:34:08.822851 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:08.822822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z"
Jul 09 13:34:12.050106 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.050071    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"]
Jul 09 13:34:12.065485 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.065438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.068087 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.068057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"]
Jul 09 13:34:12.069230 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.069125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 13:34:12.069230 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.069143    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 13:34:12.069230 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.069159    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 13:34:12.070024 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.070000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9szxb\""
Jul 09 13:34:12.070295 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.070278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 13:34:12.143983 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.143945    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nckn2"]
Jul 09 13:34:12.147175 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.147150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.150399 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.150376    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 13:34:12.150543 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.150527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dpgzs\""
Jul 09 13:34:12.165069 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.165042    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nckn2"]
Jul 09 13:34:12.174024 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.173995    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"]
Jul 09 13:34:12.176466 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.176443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.179717 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.179688    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 13:34:12.180080 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.179971    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 13:34:12.180319 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.180297    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:34:12.180445 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.179859    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-42xfs\""
Jul 09 13:34:12.180445 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.180160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 13:34:12.180670 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.180653    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 13:34:12.191641 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.189322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8jh\" (UniqueName: \"kubernetes.io/projected/70c1c102-0ec1-42cb-a1a8-edda780459f1-kube-api-access-hl8jh\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.191641 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.189378    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c1c102-0ec1-42cb-a1a8-edda780459f1-tmp\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.191641 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.189410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1c102-0ec1-42cb-a1a8-edda780459f1-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.191641 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.191401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"]
Jul 09 13:34:12.290168 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05cbb653-e313-47fa-b57a-d6ffc0f0e580-manager-config\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.290343 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shcf\" (UniqueName: \"kubernetes.io/projected/05cbb653-e313-47fa-b57a-d6ffc0f0e580-kube-api-access-4shcf\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.290343 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dg4z\" (UniqueName: \"kubernetes.io/projected/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-kube-api-access-7dg4z\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.290343 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.290343 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.290343 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8jh\" (UniqueName: \"kubernetes.io/projected/70c1c102-0ec1-42cb-a1a8-edda780459f1-kube-api-access-hl8jh\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.290534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-metrics-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.290534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c1c102-0ec1-42cb-a1a8-edda780459f1-tmp\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.290534 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.290469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1c102-0ec1-42cb-a1a8-edda780459f1-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.292796 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.292766    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70c1c102-0ec1-42cb-a1a8-edda780459f1-tmp\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.292960 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.292941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1c102-0ec1-42cb-a1a8-edda780459f1-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.309499 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.309434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8jh\" (UniqueName: \"kubernetes.io/projected/70c1c102-0ec1-42cb-a1a8-edda780459f1-kube-api-access-hl8jh\") pod \"kube-auth-proxy-7b96d9fb58-m9dl9\" (UID: \"70c1c102-0ec1-42cb-a1a8-edda780459f1\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.378462 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.378419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"
Jul 09 13:34:12.391846 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.391814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shcf\" (UniqueName: \"kubernetes.io/projected/05cbb653-e313-47fa-b57a-d6ffc0f0e580-kube-api-access-4shcf\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.392008 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.391857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dg4z\" (UniqueName: \"kubernetes.io/projected/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-kube-api-access-7dg4z\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.392285 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.392256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.392407 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.392297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.392407 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.392366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-metrics-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.392513 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.392420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05cbb653-e313-47fa-b57a-d6ffc0f0e580-manager-config\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.393203 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:34:12.393178    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 13:34:12.393203 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.393191    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05cbb653-e313-47fa-b57a-d6ffc0f0e580-manager-config\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.393357 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:34:12.393262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert podName:ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36 nodeName:}" failed. No retries permitted until 2026-07-09 13:34:12.893239632 +0000 UTC m=+289.796301753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert") pod "odh-model-controller-7998c67dc4-nckn2" (UID: "ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36") : secret "odh-model-controller-webhook-cert" not found
Jul 09 13:34:12.396158 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.395990    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-metrics-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.396330 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.396233    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cbb653-e313-47fa-b57a-d6ffc0f0e580-cert\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.406233 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.406212    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shcf\" (UniqueName: \"kubernetes.io/projected/05cbb653-e313-47fa-b57a-d6ffc0f0e580-kube-api-access-4shcf\") pod \"lws-controller-manager-7769c579dd-frq5h\" (UID: \"05cbb653-e313-47fa-b57a-d6ffc0f0e580\") " pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.406665 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.406646    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dg4z\" (UniqueName: \"kubernetes.io/projected/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-kube-api-access-7dg4z\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.494526 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.494485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:12.527464 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.527439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9"]
Jul 09 13:34:12.530052 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:34:12.530028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c1c102_0ec1_42cb_a1a8_edda780459f1.slice/crio-86525b579f9c00524bbd3c441aa13c34d5345d836d6c034d3955d70d3a7ec382 WatchSource:0}: Error finding container 86525b579f9c00524bbd3c441aa13c34d5345d836d6c034d3955d70d3a7ec382: Status 404 returned error can't find the container with id 86525b579f9c00524bbd3c441aa13c34d5345d836d6c034d3955d70d3a7ec382
Jul 09 13:34:12.634990 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.634967    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"]
Jul 09 13:34:12.637270 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:34:12.637237    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cbb653_e313_47fa_b57a_d6ffc0f0e580.slice/crio-dddd61dcbe3df47a056460eda9124fa1bb6c5dbd1bfd9e91f591cfa0c5a1dd5e WatchSource:0}: Error finding container dddd61dcbe3df47a056460eda9124fa1bb6c5dbd1bfd9e91f591cfa0c5a1dd5e: Status 404 returned error can't find the container with id dddd61dcbe3df47a056460eda9124fa1bb6c5dbd1bfd9e91f591cfa0c5a1dd5e
Jul 09 13:34:12.869603 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.869566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h" event={"ID":"05cbb653-e313-47fa-b57a-d6ffc0f0e580","Type":"ContainerStarted","Data":"dddd61dcbe3df47a056460eda9124fa1bb6c5dbd1bfd9e91f591cfa0c5a1dd5e"}
Jul 09 13:34:12.870813 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.870788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9" event={"ID":"70c1c102-0ec1-42cb-a1a8-edda780459f1","Type":"ContainerStarted","Data":"86525b579f9c00524bbd3c441aa13c34d5345d836d6c034d3955d70d3a7ec382"}
Jul 09 13:34:12.897331 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.897296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:12.899775 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:12.899754    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36-cert\") pod \"odh-model-controller-7998c67dc4-nckn2\" (UID: \"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36\") " pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:13.057540 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:13.057505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:13.213299 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:13.213234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nckn2"]
Jul 09 13:34:13.216458 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:34:13.216427    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6c6c11_2c2d_45d0_ae1e_98e1f6806b36.slice/crio-dffd29453f8fb0eaf9f14b83a2bf1569719f289e0dd597138eca023257810b91 WatchSource:0}: Error finding container dffd29453f8fb0eaf9f14b83a2bf1569719f289e0dd597138eca023257810b91: Status 404 returned error can't find the container with id dffd29453f8fb0eaf9f14b83a2bf1569719f289e0dd597138eca023257810b91
Jul 09 13:34:13.881411 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:13.881371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2" event={"ID":"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36","Type":"ContainerStarted","Data":"dffd29453f8fb0eaf9f14b83a2bf1569719f289e0dd597138eca023257810b91"}
Jul 09 13:34:17.901429 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.901367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2" event={"ID":"ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36","Type":"ContainerStarted","Data":"39aaad8a23f3e65ffe2beca61365fa2f4eb1842b446e0449b1938c30024dda34"}
Jul 09 13:34:17.901887 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.901459    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:34:17.902979 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.902948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h" event={"ID":"05cbb653-e313-47fa-b57a-d6ffc0f0e580","Type":"ContainerStarted","Data":"8848999e193d16bd80fe3eba51519114d4316a6f6d31937c364d2d52b148ed6d"}
Jul 09 13:34:17.903114 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.903007    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:17.904374 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.904354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9" event={"ID":"70c1c102-0ec1-42cb-a1a8-edda780459f1","Type":"ContainerStarted","Data":"315b776b3cca725b97e95106908f8a6944697ae0dc38c061aff8328af2cb8505"}
Jul 09 13:34:17.920524 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.920476    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2" podStartSLOduration=1.620800064 podStartE2EDuration="5.920462429s" totalImagesPullingTime="4.299662365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.919647354 +0000 UTC m=+294.822709494" watchObservedRunningTime="2026-07-09 13:34:17.920462429 +0000 UTC m=+294.823524565"
Jul 09 13:34:17.941476 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.941435    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-m9dl9" podStartSLOduration=0.966421291 podStartE2EDuration="5.94142213s" totalImagesPullingTime="4.975000839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.940418923 +0000 UTC m=+294.843481062" watchObservedRunningTime="2026-07-09 13:34:17.94142213 +0000 UTC m=+294.844484269"
Jul 09 13:34:17.963039 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:17.962980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h" podStartSLOduration=1.084650159 podStartE2EDuration="5.962962789s" totalImagesPullingTime="4.87831263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.961157458 +0000 UTC m=+294.864219610" watchObservedRunningTime="2026-07-09 13:34:17.962962789 +0000 UTC m=+294.866024926"
Jul 09 13:34:23.527050 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:23.527020    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 13:34:28.910554 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:28.910524    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7769c579dd-frq5h"
Jul 09 13:34:28.913011 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:34:28.910663    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nckn2"
Jul 09 13:36:05.739802 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.739769    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"]
Jul 09 13:36:05.742219 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.742201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.744962 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.744942    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 13:36:05.745196 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.745157    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 13:36:05.745545 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.745529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 13:36:05.745621 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.745551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 13:36:05.745986 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.745970    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gc4qp\""
Jul 09 13:36:05.756088 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.756062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"]
Jul 09 13:36:05.864521 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.864483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.864693 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.864549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnf6m\" (UniqueName: \"kubernetes.io/projected/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-kube-api-access-nnf6m\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.864693 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.864593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.965048 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.965004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.965048 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.965059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnf6m\" (UniqueName: \"kubernetes.io/projected/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-kube-api-access-nnf6m\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.965247 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.965100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.965785 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.965760    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.967402 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.967380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:05.978661 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:05.978637    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnf6m\" (UniqueName: \"kubernetes.io/projected/1a69cbd7-e2f0-4000-a71f-18ebe80f7507-kube-api-access-nnf6m\") pod \"kuadrant-console-plugin-66b5774985-mhw9k\" (UID: \"1a69cbd7-e2f0-4000-a71f-18ebe80f7507\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:06.051497 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:06.051429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"
Jul 09 13:36:06.176289 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:06.176190    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k"]
Jul 09 13:36:06.179039 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:36:06.179015    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a69cbd7_e2f0_4000_a71f_18ebe80f7507.slice/crio-a435c297e8c11272bf4efd4d6e286b6134ab8a74678a47cd8ba83c410b03d29f WatchSource:0}: Error finding container a435c297e8c11272bf4efd4d6e286b6134ab8a74678a47cd8ba83c410b03d29f: Status 404 returned error can't find the container with id a435c297e8c11272bf4efd4d6e286b6134ab8a74678a47cd8ba83c410b03d29f
Jul 09 13:36:06.180664 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:06.180646    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:36:06.283760 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:06.283726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k" event={"ID":"1a69cbd7-e2f0-4000-a71f-18ebe80f7507","Type":"ContainerStarted","Data":"a435c297e8c11272bf4efd4d6e286b6134ab8a74678a47cd8ba83c410b03d29f"}
Jul 09 13:36:29.385494 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:29.385460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k" event={"ID":"1a69cbd7-e2f0-4000-a71f-18ebe80f7507","Type":"ContainerStarted","Data":"be49efab433772f0ba38fea54a2427b5ec49babb6a6f9fb099e01d547b8792d1"}
Jul 09 13:36:29.412986 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:36:29.412882    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mhw9k" podStartSLOduration=1.440574915 podStartE2EDuration="24.412869579s" totalImagesPullingTime="22.972294664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:29.412823 +0000 UTC m=+426.315885138" watchObservedRunningTime="2026-07-09 13:36:29.412869579 +0000 UTC m=+426.315931716"
Jul 09 13:37:00.725323 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:00.725231    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:00.785811 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:00.785775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:00.785988 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:00.785900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:00.788372 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:00.788348    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6ftv\""
Jul 09 13:37:00.908811 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:00.908779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdpz\" (UniqueName: \"kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz\") pod \"authorino-58cd955675-lfhxh\" (UID: \"4847345e-b148-4aae-ae78-21963bee7135\") " pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:01.009408 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:01.009331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdpz\" (UniqueName: \"kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz\") pod \"authorino-58cd955675-lfhxh\" (UID: \"4847345e-b148-4aae-ae78-21963bee7135\") " pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:01.019540 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:01.019514    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdpz\" (UniqueName: \"kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz\") pod \"authorino-58cd955675-lfhxh\" (UID: \"4847345e-b148-4aae-ae78-21963bee7135\") " pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:01.095166 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:01.095132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:01.230749 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:01.230685    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:01.232863 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:37:01.232833    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4847345e_b148_4aae_ae78_21963bee7135.slice/crio-4864cb46b1c084a3f4d03d9d3262d1828cfa08eca57b8d19a77d4b257a637f99 WatchSource:0}: Error finding container 4864cb46b1c084a3f4d03d9d3262d1828cfa08eca57b8d19a77d4b257a637f99: Status 404 returned error can't find the container with id 4864cb46b1c084a3f4d03d9d3262d1828cfa08eca57b8d19a77d4b257a637f99
Jul 09 13:37:01.500857 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:01.500824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lfhxh" event={"ID":"4847345e-b148-4aae-ae78-21963bee7135","Type":"ContainerStarted","Data":"4864cb46b1c084a3f4d03d9d3262d1828cfa08eca57b8d19a77d4b257a637f99"}
Jul 09 13:37:04.516996 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:04.516955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lfhxh" event={"ID":"4847345e-b148-4aae-ae78-21963bee7135","Type":"ContainerStarted","Data":"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"}
Jul 09 13:37:04.535391 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:04.535343    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lfhxh" podStartSLOduration=1.399678094 podStartE2EDuration="4.535326817s" totalImagesPullingTime="3.135648723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:04.534624572 +0000 UTC m=+461.437686709" watchObservedRunningTime="2026-07-09 13:37:04.535326817 +0000 UTC m=+461.438388954"
Jul 09 13:37:05.737518 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:05.737467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:06.525022 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:06.524960    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lfhxh" podUID="4847345e-b148-4aae-ae78-21963bee7135" containerName="authorino" containerID="cri-o://7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5" gracePeriod=30
Jul 09 13:37:06.775949 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:06.775873    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:06.853665 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:06.853633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thdpz\" (UniqueName: \"kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz\") pod \"4847345e-b148-4aae-ae78-21963bee7135\" (UID: \"4847345e-b148-4aae-ae78-21963bee7135\") "
Jul 09 13:37:06.855870 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:06.855832    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz" (OuterVolumeSpecName: "kube-api-access-thdpz") pod "4847345e-b148-4aae-ae78-21963bee7135" (UID: "4847345e-b148-4aae-ae78-21963bee7135"). InnerVolumeSpecName "kube-api-access-thdpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:06.954571 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:06.954540    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thdpz\" (UniqueName: \"kubernetes.io/projected/4847345e-b148-4aae-ae78-21963bee7135-kube-api-access-thdpz\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 13:37:07.530057 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.530023    2561 generic.go:356] "Generic (PLEG): container finished" podID="4847345e-b148-4aae-ae78-21963bee7135" containerID="7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5" exitCode=0
Jul 09 13:37:07.530236 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.530074    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lfhxh"
Jul 09 13:37:07.530236 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.530111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lfhxh" event={"ID":"4847345e-b148-4aae-ae78-21963bee7135","Type":"ContainerDied","Data":"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"}
Jul 09 13:37:07.530236 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.530160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lfhxh" event={"ID":"4847345e-b148-4aae-ae78-21963bee7135","Type":"ContainerDied","Data":"4864cb46b1c084a3f4d03d9d3262d1828cfa08eca57b8d19a77d4b257a637f99"}
Jul 09 13:37:07.530236 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.530183    2561 scope.go:117] "RemoveContainer" containerID="7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"
Jul 09 13:37:07.538129 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.538112    2561 scope.go:117] "RemoveContainer" containerID="7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"
Jul 09 13:37:07.538394 ip-10-0-133-38 kubenswrapper[2561]: E0709 13:37:07.538373    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5\": container with ID starting with 7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5 not found: ID does not exist" containerID="7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"
Jul 09 13:37:07.538458 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.538404    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5"} err="failed to get container status \"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5\": rpc error: code = NotFound desc = could not find container \"7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5\": container with ID starting with 7d55ae5c0b10128442c1853adef0be8c4c7e0e26b567244703a608cab3cd93f5 not found: ID does not exist"
Jul 09 13:37:07.553394 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.553369    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:07.558210 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.558189    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lfhxh"]
Jul 09 13:37:07.662365 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:37:07.662333    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4847345e-b148-4aae-ae78-21963bee7135" path="/var/lib/kubelet/pods/4847345e-b148-4aae-ae78-21963bee7135/volumes"
Jul 09 13:38:13.961974 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.961938    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2rrr"]
Jul 09 13:38:13.962420 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.962244    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4847345e-b148-4aae-ae78-21963bee7135" containerName="authorino"
Jul 09 13:38:13.962420 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.962256    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4847345e-b148-4aae-ae78-21963bee7135" containerName="authorino"
Jul 09 13:38:13.962420 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.962299    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4847345e-b148-4aae-ae78-21963bee7135" containerName="authorino"
Jul 09 13:38:13.964318 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.964299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:13.967283 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.967254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np9j4\" (UniqueName: \"kubernetes.io/projected/389d7b28-5562-488d-a54d-cfa390b462b1-kube-api-access-np9j4\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:13.967415 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.967278    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kkpdc\""
Jul 09 13:38:13.967415 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.967356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d7b28-5562-488d-a54d-cfa390b462b1-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:13.967415 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.967406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 13:38:13.978988 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:13.978957    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2rrr"]
Jul 09 13:38:14.067930 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.067882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d7b28-5562-488d-a54d-cfa390b462b1-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:14.068100 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.068019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np9j4\" (UniqueName: \"kubernetes.io/projected/389d7b28-5562-488d-a54d-cfa390b462b1-kube-api-access-np9j4\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:14.068734 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.068704    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d7b28-5562-488d-a54d-cfa390b462b1-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:14.094294 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.094266    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np9j4\" (UniqueName: \"kubernetes.io/projected/389d7b28-5562-488d-a54d-cfa390b462b1-kube-api-access-np9j4\") pod \"payload-processing-58f86c7798-x2rrr\" (UID: \"389d7b28-5562-488d-a54d-cfa390b462b1\") " pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:14.276671 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.276590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:14.402909 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.402887    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2rrr"]
Jul 09 13:38:14.405550 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:38:14.405513    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389d7b28_5562_488d_a54d_cfa390b462b1.slice/crio-c14bcd88275e3ae71f430418f7171e325a37f20c967fdaab107a97a69867c849 WatchSource:0}: Error finding container c14bcd88275e3ae71f430418f7171e325a37f20c967fdaab107a97a69867c849: Status 404 returned error can't find the container with id c14bcd88275e3ae71f430418f7171e325a37f20c967fdaab107a97a69867c849
Jul 09 13:38:14.775087 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:14.775056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr" event={"ID":"389d7b28-5562-488d-a54d-cfa390b462b1","Type":"ContainerStarted","Data":"c14bcd88275e3ae71f430418f7171e325a37f20c967fdaab107a97a69867c849"}
Jul 09 13:38:16.784753 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:16.784720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr" event={"ID":"389d7b28-5562-488d-a54d-cfa390b462b1","Type":"ContainerStarted","Data":"a28d623096aeeb89ecf3749d8da5743b7f16bc72aa25479b615969b340ddba37"}
Jul 09 13:38:16.785135 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:16.784779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:16.822874 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:16.822835    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr" podStartSLOduration=2.223819295 podStartE2EDuration="3.822822338s" totalImagesPullingTime="1.599003043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:38:16.822793295 +0000 UTC m=+533.725855432" watchObservedRunningTime="2026-07-09 13:38:16.822822338 +0000 UTC m=+533.725884474"
Jul 09 13:38:27.789865 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:27.789838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-x2rrr"
Jul 09 13:38:54.588295 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.588262    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"]
Jul 09 13:38:54.591303 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.591287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.595124 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.595097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 13:38:54.595124 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.595111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 13:38:54.595124 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.595105    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 13:38:54.595301 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.595133    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hq9dz\""
Jul 09 13:38:54.602403 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.602380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"]
Jul 09 13:38:54.665537 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.665680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.665680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.665680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43e23156-67cc-49e9-959a-88b891239095-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.665680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.665858 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.665765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9r7p\" (UniqueName: \"kubernetes.io/projected/43e23156-67cc-49e9-959a-88b891239095-kube-api-access-r9r7p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766581 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766581 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766801 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766801 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43e23156-67cc-49e9-959a-88b891239095-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766801 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.766801 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.766737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9r7p\" (UniqueName: \"kubernetes.io/projected/43e23156-67cc-49e9-959a-88b891239095-kube-api-access-r9r7p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.767114 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.767082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.767240 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.767160    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.767240 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.767196    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.768763 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.768743    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43e23156-67cc-49e9-959a-88b891239095-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.769044 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.769026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43e23156-67cc-49e9-959a-88b891239095-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.777629 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.777606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9r7p\" (UniqueName: \"kubernetes.io/projected/43e23156-67cc-49e9-959a-88b891239095-kube-api-access-r9r7p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k5qvr\" (UID: \"43e23156-67cc-49e9-959a-88b891239095\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:54.901670 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:54.901636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:38:55.032337 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:55.032307    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"]
Jul 09 13:38:55.035414 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:38:55.035387    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e23156_67cc_49e9_959a_88b891239095.slice/crio-8fbc29928da36b1a9763fc57b26d267a38a9c381e744978303e230930911c52e WatchSource:0}: Error finding container 8fbc29928da36b1a9763fc57b26d267a38a9c381e744978303e230930911c52e: Status 404 returned error can't find the container with id 8fbc29928da36b1a9763fc57b26d267a38a9c381e744978303e230930911c52e
Jul 09 13:38:55.933128 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:38:55.933095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr" event={"ID":"43e23156-67cc-49e9-959a-88b891239095","Type":"ContainerStarted","Data":"8fbc29928da36b1a9763fc57b26d267a38a9c381e744978303e230930911c52e"}
Jul 09 13:39:00.953600 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:00.953562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr" event={"ID":"43e23156-67cc-49e9-959a-88b891239095","Type":"ContainerStarted","Data":"68441541be4ea8624e5a895604e053281c75b96d96e5f330d1375d9c75433113"}
Jul 09 13:39:00.975986 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:00.975931    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr" podStartSLOduration=1.18766334 podStartE2EDuration="6.975898719s" totalImagesPullingTime="5.788235379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:39:00.973729545 +0000 UTC m=+577.876791706" watchObservedRunningTime="2026-07-09 13:39:00.975898719 +0000 UTC m=+577.878960856"
Jul 09 13:39:04.182913 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.182878    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"]
Jul 09 13:39:04.186166 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.186145    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.190412 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.190396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 13:39:04.211835 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.211813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"]
Jul 09 13:39:04.351568 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351532    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqk8b\" (UniqueName: \"kubernetes.io/projected/6e0c1c9e-5701-4365-81ec-581c17a04715-kube-api-access-gqk8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.351748 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e0c1c9e-5701-4365-81ec-581c17a04715-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.351748 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.351748 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.351748 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.351943 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.351770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.452649 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.452649 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.452649 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.452649 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.453000 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqk8b\" (UniqueName: \"kubernetes.io/projected/6e0c1c9e-5701-4365-81ec-581c17a04715-kube-api-access-gqk8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.453000 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.452694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e0c1c9e-5701-4365-81ec-581c17a04715-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.453103 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.453000    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.453103 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.453091    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.453174 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.453111    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.454977 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.454947    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e0c1c9e-5701-4365-81ec-581c17a04715-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.455192 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.455177    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e0c1c9e-5701-4365-81ec-581c17a04715-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.463545 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.463520    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqk8b\" (UniqueName: \"kubernetes.io/projected/6e0c1c9e-5701-4365-81ec-581c17a04715-kube-api-access-gqk8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6\" (UID: \"6e0c1c9e-5701-4365-81ec-581c17a04715\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.495508 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.495484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:04.623286 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.623252    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"]
Jul 09 13:39:04.627432 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:39:04.627404    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0c1c9e_5701_4365_81ec_581c17a04715.slice/crio-a59a2b0f39796a141e2126b3893e795734771c8ccf8e04f6da759b0c34ebcf57 WatchSource:0}: Error finding container a59a2b0f39796a141e2126b3893e795734771c8ccf8e04f6da759b0c34ebcf57: Status 404 returned error can't find the container with id a59a2b0f39796a141e2126b3893e795734771c8ccf8e04f6da759b0c34ebcf57
Jul 09 13:39:04.902171 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.902148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:39:04.902453 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.902425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:39:04.918279 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.918257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:39:04.975541 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.975506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6" event={"ID":"6e0c1c9e-5701-4365-81ec-581c17a04715","Type":"ContainerStarted","Data":"f63f21586df0f62f056ed11b693d2628de93339e6ec6102d76aa29909ab5df1c"}
Jul 09 13:39:04.975680 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.975562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6" event={"ID":"6e0c1c9e-5701-4365-81ec-581c17a04715","Type":"ContainerStarted","Data":"a59a2b0f39796a141e2126b3893e795734771c8ccf8e04f6da759b0c34ebcf57"}
Jul 09 13:39:04.987228 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.987207    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k5qvr"
Jul 09 13:39:04.997290 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:04.997242    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6" podStartSLOduration=0.723838061 podStartE2EDuration="997.224644ms" totalImagesPullingTime="273.386583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:39:04.995532046 +0000 UTC m=+581.898594194" watchObservedRunningTime="2026-07-09 13:39:04.997224644 +0000 UTC m=+581.900286783"
Jul 09 13:39:14.496223 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:14.496185    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:14.496595 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:14.496270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:14.508631 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:14.508605    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:15.024757 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:15.024728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6"
Jul 09 13:39:22.178566 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.178534    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"]
Jul 09 13:39:22.183019 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.182999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.187932 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.187902    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 13:39:22.201998 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.201976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.202096 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.202006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.202096 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.202032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4lfx\" (UniqueName: \"kubernetes.io/projected/91f7093f-38f2-4c7a-8857-77842326af88-kube-api-access-w4lfx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.202167 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.202104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.202167 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.202150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.202236 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.202218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f7093f-38f2-4c7a-8857-77842326af88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.205963 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.205912    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"]
Jul 09 13:39:22.303504 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f7093f-38f2-4c7a-8857-77842326af88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303662 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303662 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303780 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4lfx\" (UniqueName: \"kubernetes.io/projected/91f7093f-38f2-4c7a-8857-77842326af88-kube-api-access-w4lfx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303780 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303780 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.303960 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.303903    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.304139 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.304118    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.304139 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.304131    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.305823 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.305803    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f7093f-38f2-4c7a-8857-77842326af88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.306123 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.306108    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f7093f-38f2-4c7a-8857-77842326af88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.320996 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.320971    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4lfx\" (UniqueName: \"kubernetes.io/projected/91f7093f-38f2-4c7a-8857-77842326af88-kube-api-access-w4lfx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd\" (UID: \"91f7093f-38f2-4c7a-8857-77842326af88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.492108 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.492030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:22.624582 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:22.624438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"]
Jul 09 13:39:22.626631 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:39:22.626596    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91f7093f_38f2_4c7a_8857_77842326af88.slice/crio-c18ede28ed4474130ec091283462d4786fbe949e2f15e642bb6d78910f62872f WatchSource:0}: Error finding container c18ede28ed4474130ec091283462d4786fbe949e2f15e642bb6d78910f62872f: Status 404 returned error can't find the container with id c18ede28ed4474130ec091283462d4786fbe949e2f15e642bb6d78910f62872f
Jul 09 13:39:23.047008 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:23.046971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd" event={"ID":"91f7093f-38f2-4c7a-8857-77842326af88","Type":"ContainerStarted","Data":"4cd1b930841a5ab013daa60558a55290a4e431219a66277d76d639bd725985aa"}
Jul 09 13:39:23.047214 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:23.047018    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd" event={"ID":"91f7093f-38f2-4c7a-8857-77842326af88","Type":"ContainerStarted","Data":"c18ede28ed4474130ec091283462d4786fbe949e2f15e642bb6d78910f62872f"}
Jul 09 13:39:23.067279 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:23.067234    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd" podStartSLOduration=0.84717136 podStartE2EDuration="1.067218435s" totalImagesPullingTime="220.047075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:39:23.06580986 +0000 UTC m=+599.968871999" watchObservedRunningTime="2026-07-09 13:39:23.067218435 +0000 UTC m=+599.970280592"
Jul 09 13:39:32.493017 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:32.492980    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:32.495397 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:32.493031    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:32.505362 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:32.505339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:39:33.097926 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:39:33.097887    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd"
Jul 09 13:40:04.503844 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.503815    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ffc854cb6-wdgzd"]
Jul 09 13:40:04.507120 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.507099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.510776 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.510751    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6ftv\""
Jul 09 13:40:04.510905 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.510751    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 13:40:04.516052 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.516031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffc854cb6-wdgzd"]
Jul 09 13:40:04.654379 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.654346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec4e199e-c402-4faa-b02d-430d0e089f1f-tls-cert\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.654520 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.654413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z992z\" (UniqueName: \"kubernetes.io/projected/ec4e199e-c402-4faa-b02d-430d0e089f1f-kube-api-access-z992z\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.754858 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.754767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec4e199e-c402-4faa-b02d-430d0e089f1f-tls-cert\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.755041 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.754868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z992z\" (UniqueName: \"kubernetes.io/projected/ec4e199e-c402-4faa-b02d-430d0e089f1f-kube-api-access-z992z\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.757355 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.757325    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec4e199e-c402-4faa-b02d-430d0e089f1f-tls-cert\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.767930 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.767888    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z992z\" (UniqueName: \"kubernetes.io/projected/ec4e199e-c402-4faa-b02d-430d0e089f1f-kube-api-access-z992z\") pod \"authorino-ffc854cb6-wdgzd\" (UID: \"ec4e199e-c402-4faa-b02d-430d0e089f1f\") " pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.815594 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.815563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffc854cb6-wdgzd"
Jul 09 13:40:04.956759 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:04.956739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffc854cb6-wdgzd"]
Jul 09 13:40:04.958575 ip-10-0-133-38 kubenswrapper[2561]: W0709 13:40:04.958549    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec4e199e_c402_4faa_b02d_430d0e089f1f.slice/crio-04a15ac5e55a1228237aee884fc62f2d210fc7e9b96e43978bcd9ec72fc136e3 WatchSource:0}: Error finding container 04a15ac5e55a1228237aee884fc62f2d210fc7e9b96e43978bcd9ec72fc136e3: Status 404 returned error can't find the container with id 04a15ac5e55a1228237aee884fc62f2d210fc7e9b96e43978bcd9ec72fc136e3
Jul 09 13:40:05.221201 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:05.221163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffc854cb6-wdgzd" event={"ID":"ec4e199e-c402-4faa-b02d-430d0e089f1f","Type":"ContainerStarted","Data":"04a15ac5e55a1228237aee884fc62f2d210fc7e9b96e43978bcd9ec72fc136e3"}
Jul 09 13:40:06.227140 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:06.227097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffc854cb6-wdgzd" event={"ID":"ec4e199e-c402-4faa-b02d-430d0e089f1f","Type":"ContainerStarted","Data":"d6358e83e55a9a74e162c5fbc57f766f9f40f76af244c9d45ed880b34956a584"}
Jul 09 13:40:06.251016 ip-10-0-133-38 kubenswrapper[2561]: I0709 13:40:06.250955    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ffc854cb6-wdgzd" podStartSLOduration=1.879673567 podStartE2EDuration="2.250935845s" totalImagesPullingTime="371.262278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:40:06.25000067 +0000 UTC m=+643.153062806" watchObservedRunningTime="2026-07-09 13:40:06.250935845 +0000 UTC m=+643.153997980"
Jul 09 14:02:54.109623 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.109548    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:02:54.112615 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.112599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.118929 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.118893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-505c59\"/\"default-dockercfg-f5bbw\""
Jul 09 14:02:54.119835 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.119810    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-505c59\"/\"kube-root-ca.crt\""
Jul 09 14:02:54.119972 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.119880    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-505c59\"/\"openshift-service-ca.crt\""
Jul 09 14:02:54.120046 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.120015    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-505c59\"/\"test-model-505c59-kserve-self-signed-certs\""
Jul 09 14:02:54.125671 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.125649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:02:54.304323 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.304323 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.304521 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.304521 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.304521 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45fqs\" (UniqueName: \"kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.304521 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.304475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405566 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405566 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405788 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405788 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405788 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45fqs\" (UniqueName: \"kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.405788 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.405714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.406041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.406016    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.406093 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.406056    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.406093 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.406086    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.407935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.407895    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.408175 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.408158    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.416291 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.416270    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45fqs\" (UniqueName: \"kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs\") pod \"test-model-505c59-kserve-7bd7b96995-5nml8\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") " pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.427068 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.427047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:02:54.564735 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.564710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:02:54.566701 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:02:54.566672    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83de187d_7e8e_4615_8121_a00e1785ca7d.slice/crio-5e85634e1c6b6c727d9d102bebcf1ea3c5b3e846042404d6a2ab181c6ffa4d0c WatchSource:0}: Error finding container 5e85634e1c6b6c727d9d102bebcf1ea3c5b3e846042404d6a2ab181c6ffa4d0c: Status 404 returned error can't find the container with id 5e85634e1c6b6c727d9d102bebcf1ea3c5b3e846042404d6a2ab181c6ffa4d0c
Jul 09 14:02:54.786355 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.786258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" event={"ID":"83de187d-7e8e-4615-8121-a00e1785ca7d","Type":"ContainerStarted","Data":"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"}
Jul 09 14:02:54.786355 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.786301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" event={"ID":"83de187d-7e8e-4615-8121-a00e1785ca7d","Type":"ContainerStarted","Data":"5e85634e1c6b6c727d9d102bebcf1ea3c5b3e846042404d6a2ab181c6ffa4d0c"}
Jul 09 14:02:54.806646 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:02:54.806590    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" podStartSLOduration=0.806574997 podStartE2EDuration="806.574997ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:54.806111906 +0000 UTC m=+2011.709174042" watchObservedRunningTime="2026-07-09 14:02:54.806574997 +0000 UTC m=+2011.709637137"
Jul 09 14:03:04.427824 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:04.427787    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:03:04.428225 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:04.427839    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:03:04.440392 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:04.440363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:03:04.837976 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:04.837876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:03:29.485240 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.485206    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:03:29.488355 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.488334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.492183 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.492159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"test-model-d43b1d-kserve-self-signed-certs\""
Jul 09 14:03:29.492309 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.492196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"kube-root-ca.crt\""
Jul 09 14:03:29.492309 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.492229    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"default-dockercfg-m9kk8\""
Jul 09 14:03:29.492309 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.492231    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"openshift-service-ca.crt\""
Jul 09 14:03:29.499395 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.499372    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:03:29.611354 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.611518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.611518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8ljl\" (UniqueName: \"kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.611518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.611518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.611518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.611516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.712758 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.712935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.712935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.712935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8ljl\" (UniqueName: \"kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.712935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.713071 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.712962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.713298 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.713275    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.713341 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.713308    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.713341 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.713285    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.715200 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.715173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.715556 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.715536    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.721790 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.721765    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8ljl\" (UniqueName: \"kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl\") pod \"test-model-d43b1d-kserve-747d4fb54f-d7znd\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.797094 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.796997    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:29.930439 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:29.930413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:03:29.933344 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:03:29.933318    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b73f8b0_cd49_4e30_9982_71fde8ecd660.slice/crio-559cd72a9757a9957aa67706de1d840dc2a84e2cb82d3e03f1624b376ad7cd6e WatchSource:0}: Error finding container 559cd72a9757a9957aa67706de1d840dc2a84e2cb82d3e03f1624b376ad7cd6e: Status 404 returned error can't find the container with id 559cd72a9757a9957aa67706de1d840dc2a84e2cb82d3e03f1624b376ad7cd6e
Jul 09 14:03:30.941812 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:30.941778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" event={"ID":"6b73f8b0-cd49-4e30-9982-71fde8ecd660","Type":"ContainerStarted","Data":"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"}
Jul 09 14:03:30.942208 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:30.941817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" event={"ID":"6b73f8b0-cd49-4e30-9982-71fde8ecd660","Type":"ContainerStarted","Data":"559cd72a9757a9957aa67706de1d840dc2a84e2cb82d3e03f1624b376ad7cd6e"}
Jul 09 14:03:30.962385 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:30.962339    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" podStartSLOduration=1.962323311 podStartE2EDuration="1.962323311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:30.960056998 +0000 UTC m=+2047.863119136" watchObservedRunningTime="2026-07-09 14:03:30.962323311 +0000 UTC m=+2047.865385450"
Jul 09 14:03:39.797169 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:39.797130    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:39.797722 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:39.797704    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:39.819251 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:39.819218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:39.998487 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:39.998459    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:03:50.131262 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:03:50.131229    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:04:05.151278 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.151215    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" podUID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" containerName="main" containerID="cri-o://d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a" gracePeriod=45
Jul 09 14:04:05.399396 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.399370    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:04:05.502051 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.501964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8ljl\" (UniqueName: \"kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502051 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502018    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502051 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502291 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502291 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502291 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache\") pod \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\" (UID: \"6b73f8b0-cd49-4e30-9982-71fde8ecd660\") "
Jul 09 14:04:05.502447 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502289    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:04:05.502501 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502434    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home" (OuterVolumeSpecName: "home") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:04:05.502547 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502509    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-home\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:05.502582 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502552    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tmp-dir\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:05.502582 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.502549    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:04:05.504305 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.504274    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:04:05.504305 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.504296    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm" (OuterVolumeSpecName: "dshm") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:04:05.504440 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.504352    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl" (OuterVolumeSpecName: "kube-api-access-g8ljl") pod "6b73f8b0-cd49-4e30-9982-71fde8ecd660" (UID: "6b73f8b0-cd49-4e30-9982-71fde8ecd660"). InnerVolumeSpecName "kube-api-access-g8ljl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:04:05.603723 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.603692    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8ljl\" (UniqueName: \"kubernetes.io/projected/6b73f8b0-cd49-4e30-9982-71fde8ecd660-kube-api-access-g8ljl\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:05.603723 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.603716    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-dshm\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:05.603723 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.603725    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b73f8b0-cd49-4e30-9982-71fde8ecd660-tls-certs\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:05.603954 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:05.603734    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b73f8b0-cd49-4e30-9982-71fde8ecd660-model-cache\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:04:06.088411 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.088379    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" containerID="d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a" exitCode=0
Jul 09 14:04:06.088587 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.088422    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"
Jul 09 14:04:06.088587 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.088442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" event={"ID":"6b73f8b0-cd49-4e30-9982-71fde8ecd660","Type":"ContainerDied","Data":"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"}
Jul 09 14:04:06.088587 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.088473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd" event={"ID":"6b73f8b0-cd49-4e30-9982-71fde8ecd660","Type":"ContainerDied","Data":"559cd72a9757a9957aa67706de1d840dc2a84e2cb82d3e03f1624b376ad7cd6e"}
Jul 09 14:04:06.088587 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.088491    2561 scope.go:117] "RemoveContainer" containerID="d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"
Jul 09 14:04:06.096471 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.096452    2561 scope.go:117] "RemoveContainer" containerID="d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"
Jul 09 14:04:06.096731 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:04:06.096714    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a\": container with ID starting with d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a not found: ID does not exist" containerID="d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"
Jul 09 14:04:06.096779 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.096738    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a"} err="failed to get container status \"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a\": rpc error: code = NotFound desc = could not find container \"d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a\": container with ID starting with d57cfae4aa8e96f8f60666507c2ad911f308ffbdb823ad651ce5ec1ef928fc6a not found: ID does not exist"
Jul 09 14:04:06.108554 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.108531    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:04:06.114408 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:06.114385    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-d7znd"]
Jul 09 14:04:07.662851 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:07.662818    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" path="/var/lib/kubelet/pods/6b73f8b0-cd49-4e30-9982-71fde8ecd660/volumes"
Jul 09 14:04:54.767035 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.767001    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:04:54.767488 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.767317    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" containerName="main"
Jul 09 14:04:54.767488 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.767328    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" containerName="main"
Jul 09 14:04:54.767488 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.767388    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b73f8b0-cd49-4e30-9982-71fde8ecd660" containerName="main"
Jul 09 14:04:54.770357 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.770338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.772886 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.772865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"kube-root-ca.crt\""
Jul 09 14:04:54.774031 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.774013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"default-dockercfg-r6dvv\""
Jul 09 14:04:54.774129 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.774013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"test-model-d43b1d-kserve-self-signed-certs\""
Jul 09 14:04:54.774129 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.774054    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-d43b1d\"/\"openshift-service-ca.crt\""
Jul 09 14:04:54.791792 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.791763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:04:54.813302 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.813414 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltx6x\" (UniqueName: \"kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.813414 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.813484 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.813518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.813577 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.813555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.914980 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.914948    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915153 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915153 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915153 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltx6x\" (UniqueName: \"kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915153 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915153 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915518 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915490    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915635 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915546    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.915635 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.915583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.917368 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.917347    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.917624 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.917607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:54.924123 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:54.924102    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltx6x\" (UniqueName: \"kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x\") pod \"test-model-d43b1d-kserve-747d4fb54f-kvr8w\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") " pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:55.078897 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:55.078809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:04:55.208569 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:55.208530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:04:55.211482 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:04:55.211455    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1b3ef8f_004c_4bee_bca2_1a485cf01404.slice/crio-005c1667c2abbe5c1b1bbc69419e04d5add1beaed96ccb5227105d66a5723ed6 WatchSource:0}: Error finding container 005c1667c2abbe5c1b1bbc69419e04d5add1beaed96ccb5227105d66a5723ed6: Status 404 returned error can't find the container with id 005c1667c2abbe5c1b1bbc69419e04d5add1beaed96ccb5227105d66a5723ed6
Jul 09 14:04:55.297984 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:55.297948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" event={"ID":"d1b3ef8f-004c-4bee-bca2-1a485cf01404","Type":"ContainerStarted","Data":"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"}
Jul 09 14:04:55.298140 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:55.297996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" event={"ID":"d1b3ef8f-004c-4bee-bca2-1a485cf01404","Type":"ContainerStarted","Data":"005c1667c2abbe5c1b1bbc69419e04d5add1beaed96ccb5227105d66a5723ed6"}
Jul 09 14:04:55.316484 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:04:55.316439    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" podStartSLOduration=1.316425712 podStartE2EDuration="1.316425712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:55.31608776 +0000 UTC m=+2132.219149892" watchObservedRunningTime="2026-07-09 14:04:55.316425712 +0000 UTC m=+2132.219487868"
Jul 09 14:05:05.079860 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:05.079819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:05.080316 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:05.079889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:05.092175 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:05.092153    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:05.357531 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:05.357452    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:25.155831 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:25.155748    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:05:40.179401 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.179357    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" podUID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" containerName="main" containerID="cri-o://2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723" gracePeriod=45
Jul 09 14:05:40.425245 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.425210    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:40.491758 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.491669    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" containerID="2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723" exitCode=0
Jul 09 14:05:40.491758 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.491731    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"
Jul 09 14:05:40.491948 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.491751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" event={"ID":"d1b3ef8f-004c-4bee-bca2-1a485cf01404","Type":"ContainerDied","Data":"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"}
Jul 09 14:05:40.491948 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.491793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w" event={"ID":"d1b3ef8f-004c-4bee-bca2-1a485cf01404","Type":"ContainerDied","Data":"005c1667c2abbe5c1b1bbc69419e04d5add1beaed96ccb5227105d66a5723ed6"}
Jul 09 14:05:40.491948 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.491817    2561 scope.go:117] "RemoveContainer" containerID="2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"
Jul 09 14:05:40.498713 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.498847 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.498847 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.498847 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498844    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.499022 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltx6x\" (UniqueName: \"kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.499022 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498884    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home" (OuterVolumeSpecName: "home") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:05:40.499022 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.498913    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir\") pod \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\" (UID: \"d1b3ef8f-004c-4bee-bca2-1a485cf01404\") "
Jul 09 14:05:40.499166 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.499029    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:05:40.499263 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.499244    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-home\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.499320 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.499248    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:05:40.499320 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.499267    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-model-cache\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.500161 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.500138    2561 scope.go:117] "RemoveContainer" containerID="2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"
Jul 09 14:05:40.500464 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:05:40.500437    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723\": container with ID starting with 2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723 not found: ID does not exist" containerID="2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"
Jul 09 14:05:40.500540 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.500477    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723"} err="failed to get container status \"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723\": rpc error: code = NotFound desc = could not find container \"2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723\": container with ID starting with 2ffbc9eeb9dbc5cb69ba371af6a018229c92b21a850024763239ce6232f6c723 not found: ID does not exist"
Jul 09 14:05:40.501109 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.501082    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm" (OuterVolumeSpecName: "dshm") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:05:40.501219 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.501108    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x" (OuterVolumeSpecName: "kube-api-access-ltx6x") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "kube-api-access-ltx6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:05:40.501219 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.501155    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1b3ef8f-004c-4bee-bca2-1a485cf01404" (UID: "d1b3ef8f-004c-4bee-bca2-1a485cf01404"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:05:40.599682 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.599649    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tls-certs\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.599682 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.599675    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-dshm\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.599682 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.599685    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltx6x\" (UniqueName: \"kubernetes.io/projected/d1b3ef8f-004c-4bee-bca2-1a485cf01404-kube-api-access-ltx6x\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.599892 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.599693    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b3ef8f-004c-4bee-bca2-1a485cf01404-tmp-dir\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:05:40.816802 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.816773    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:05:40.821631 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:40.821599    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-d43b1d/test-model-d43b1d-kserve-747d4fb54f-kvr8w"]
Jul 09 14:05:41.663090 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:05:41.663055    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" path="/var/lib/kubelet/pods/d1b3ef8f-004c-4bee-bca2-1a485cf01404/volumes"
Jul 09 14:06:12.286805 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:12.286769    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:06:27.306379 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.306313    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" podUID="83de187d-7e8e-4615-8121-a00e1785ca7d" containerName="main" containerID="cri-o://a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325" gracePeriod=45
Jul 09 14:06:27.554842 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.554818    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:06:27.690535 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690505    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.690720 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690555    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45fqs\" (UniqueName: \"kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.690720 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.690720 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.690720 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690716    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.690952 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home\") pod \"83de187d-7e8e-4615-8121-a00e1785ca7d\" (UID: \"83de187d-7e8e-4615-8121-a00e1785ca7d\") "
Jul 09 14:06:27.691016 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690945    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:27.691016 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.690970    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:27.691126 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.691039    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-model-cache\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:27.691194 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.691172    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home" (OuterVolumeSpecName: "home") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:27.693027 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.692986    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:06:27.693122 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693063    2561 generic.go:356] "Generic (PLEG): container finished" podID="83de187d-7e8e-4615-8121-a00e1785ca7d" containerID="a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325" exitCode=0
Jul 09 14:06:27.693122 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693070    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm" (OuterVolumeSpecName: "dshm") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:27.693122 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693083    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs" (OuterVolumeSpecName: "kube-api-access-45fqs") pod "83de187d-7e8e-4615-8121-a00e1785ca7d" (UID: "83de187d-7e8e-4615-8121-a00e1785ca7d"). InnerVolumeSpecName "kube-api-access-45fqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:06:27.693122 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693120    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"
Jul 09 14:06:27.693276 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" event={"ID":"83de187d-7e8e-4615-8121-a00e1785ca7d","Type":"ContainerDied","Data":"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"}
Jul 09 14:06:27.693276 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8" event={"ID":"83de187d-7e8e-4615-8121-a00e1785ca7d","Type":"ContainerDied","Data":"5e85634e1c6b6c727d9d102bebcf1ea3c5b3e846042404d6a2ab181c6ffa4d0c"}
Jul 09 14:06:27.693276 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.693182    2561 scope.go:117] "RemoveContainer" containerID="a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"
Jul 09 14:06:27.709239 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.709220    2561 scope.go:117] "RemoveContainer" containerID="a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"
Jul 09 14:06:27.709507 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:06:27.709481    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325\": container with ID starting with a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325 not found: ID does not exist" containerID="a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"
Jul 09 14:06:27.709606 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.709509    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325"} err="failed to get container status \"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325\": rpc error: code = NotFound desc = could not find container \"a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325\": container with ID starting with a6f2d2e2ffb09fa87c26f30161e42362f0694ef4c256517b15763a6ccfdd3325 not found: ID does not exist"
Jul 09 14:06:27.723526 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.723504    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:06:27.730161 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.730141    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-505c59/test-model-505c59-kserve-7bd7b96995-5nml8"]
Jul 09 14:06:27.792357 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.792334    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-tmp-dir\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:27.792357 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.792355    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-dshm\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:27.792357 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.792363    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83de187d-7e8e-4615-8121-a00e1785ca7d-home\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:27.792590 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.792371    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83de187d-7e8e-4615-8121-a00e1785ca7d-tls-certs\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:27.792590 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:27.792379    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45fqs\" (UniqueName: \"kubernetes.io/projected/83de187d-7e8e-4615-8121-a00e1785ca7d-kube-api-access-45fqs\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:06:29.663394 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:06:29.663365    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83de187d-7e8e-4615-8121-a00e1785ca7d" path="/var/lib/kubelet/pods/83de187d-7e8e-4615-8121-a00e1785ca7d/volumes"
Jul 09 14:07:15.645403 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645366    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645706    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83de187d-7e8e-4615-8121-a00e1785ca7d" containerName="main"
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645720    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="83de187d-7e8e-4615-8121-a00e1785ca7d" containerName="main"
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645739    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" containerName="main"
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645745    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" containerName="main"
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645795    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="83de187d-7e8e-4615-8121-a00e1785ca7d" containerName="main"
Jul 09 14:07:15.645956 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.645806    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b3ef8f-004c-4bee-bca2-1a485cf01404" containerName="main"
Jul 09 14:07:15.658939 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.658737    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.661926 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.661876    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 14:07:15.662536 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.662516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-606620-serving-cert\""
Jul 09 14:07:15.662980 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.662780    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 14:07:15.663637 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.662838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z2qnx\""
Jul 09 14:07:15.667102 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.666671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:15.774519 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.774486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.774691 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.774534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.774691 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.774614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8vq\" (UniqueName: \"kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.875850 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.875814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.876067 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.875865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8vq\" (UniqueName: \"kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.876067 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.875943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.876067 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:07:15.876050    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-606620-serving-cert: secret "maas-api-e2e-api-b-606620-serving-cert" not found
Jul 09 14:07:15.876228 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:07:15.876117    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls podName:f944e068-5ee8-4e3b-9856-e6b8e8b090e4 nodeName:}" failed. No retries permitted until 2026-07-09 14:07:16.376096572 +0000 UTC m=+2273.279158687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls") pod "maas-api-e2e-api-b-606620-677d78887d-rtjr8" (UID: "f944e068-5ee8-4e3b-9856-e6b8e8b090e4") : secret "maas-api-e2e-api-b-606620-serving-cert" not found
Jul 09 14:07:15.876460 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.876436    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:15.886714 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:15.886684    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8vq\" (UniqueName: \"kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:16.380762 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.380730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:16.383166 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.383139    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") pod \"maas-api-e2e-api-b-606620-677d78887d-rtjr8\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:16.573581 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.573551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:16.703479 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.703361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:16.706212 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:07:16.706188    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf944e068_5ee8_4e3b_9856_e6b8e8b090e4.slice/crio-9b84db161b77689007f33550ca2e367b15e0034bb290d7e020492acc65c60c02 WatchSource:0}: Error finding container 9b84db161b77689007f33550ca2e367b15e0034bb290d7e020492acc65c60c02: Status 404 returned error can't find the container with id 9b84db161b77689007f33550ca2e367b15e0034bb290d7e020492acc65c60c02
Jul 09 14:07:16.707635 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.707617    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:07:16.894038 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:16.893999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" event={"ID":"f944e068-5ee8-4e3b-9856-e6b8e8b090e4","Type":"ContainerStarted","Data":"9b84db161b77689007f33550ca2e367b15e0034bb290d7e020492acc65c60c02"}
Jul 09 14:07:21.917226 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:21.917193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" event={"ID":"f944e068-5ee8-4e3b-9856-e6b8e8b090e4","Type":"ContainerStarted","Data":"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"}
Jul 09 14:07:21.917593 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:21.917289    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:21.940634 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:21.940588    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" podStartSLOduration=2.102728392 podStartE2EDuration="6.940576293s" totalImagesPullingTime="4.837847901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:07:21.940259896 +0000 UTC m=+2278.843322033" watchObservedRunningTime="2026-07-09 14:07:21.940576293 +0000 UTC m=+2278.843638430"
Jul 09 14:07:27.926968 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:27.926939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:41.309954 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.309903    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:41.310342 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.310134    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" podUID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" containerName="maas-api" containerID="cri-o://c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c" gracePeriod=30
Jul 09 14:07:41.554112 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.554087    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:41.575174 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.575106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") pod \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") "
Jul 09 14:07:41.575174 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.575153    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls8vq\" (UniqueName: \"kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq\") pod \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") "
Jul 09 14:07:41.575350 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.575191    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca\") pod \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\" (UID: \"f944e068-5ee8-4e3b-9856-e6b8e8b090e4\") "
Jul 09 14:07:41.575736 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.575705    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f944e068-5ee8-4e3b-9856-e6b8e8b090e4" (UID: "f944e068-5ee8-4e3b-9856-e6b8e8b090e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:07:41.577760 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.577725    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f944e068-5ee8-4e3b-9856-e6b8e8b090e4" (UID: "f944e068-5ee8-4e3b-9856-e6b8e8b090e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:07:41.578043 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.578017    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq" (OuterVolumeSpecName: "kube-api-access-ls8vq") pod "f944e068-5ee8-4e3b-9856-e6b8e8b090e4" (UID: "f944e068-5ee8-4e3b-9856-e6b8e8b090e4"). InnerVolumeSpecName "kube-api-access-ls8vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:07:41.676469 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.676445    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-maas-api-tls\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:07:41.676557 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.676471    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls8vq\" (UniqueName: \"kubernetes.io/projected/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-kube-api-access-ls8vq\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:07:41.676557 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.676482    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f944e068-5ee8-4e3b-9856-e6b8e8b090e4-openshift-service-ca\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:07:41.998446 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.998410    2561 generic.go:356] "Generic (PLEG): container finished" podID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" containerID="c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c" exitCode=0
Jul 09 14:07:41.998614 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.998454    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"
Jul 09 14:07:41.998614 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.998457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" event={"ID":"f944e068-5ee8-4e3b-9856-e6b8e8b090e4","Type":"ContainerDied","Data":"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"}
Jul 09 14:07:41.998614 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.998526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8" event={"ID":"f944e068-5ee8-4e3b-9856-e6b8e8b090e4","Type":"ContainerDied","Data":"9b84db161b77689007f33550ca2e367b15e0034bb290d7e020492acc65c60c02"}
Jul 09 14:07:41.998614 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:41.998556    2561 scope.go:117] "RemoveContainer" containerID="c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"
Jul 09 14:07:42.006394 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:42.006375    2561 scope.go:117] "RemoveContainer" containerID="c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"
Jul 09 14:07:42.006660 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:07:42.006640    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c\": container with ID starting with c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c not found: ID does not exist" containerID="c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"
Jul 09 14:07:42.006703 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:42.006669    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c"} err="failed to get container status \"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c\": rpc error: code = NotFound desc = could not find container \"c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c\": container with ID starting with c2b526aae4d341ab185201e4651508ef38579f2d3055fa72f9f22ff687913d8c not found: ID does not exist"
Jul 09 14:07:42.019428 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:42.019407    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:42.023299 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:42.023278    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-606620-677d78887d-rtjr8"]
Jul 09 14:07:43.664179 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:43.664145    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" path="/var/lib/kubelet/pods/f944e068-5ee8-4e3b-9856-e6b8e8b090e4/volumes"
Jul 09 14:07:51.937692 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.937658    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:07:51.938148 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.938119    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" containerName="maas-api"
Jul 09 14:07:51.938148 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.938148    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" containerName="maas-api"
Jul 09 14:07:51.938262 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.938241    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f944e068-5ee8-4e3b-9856-e6b8e8b090e4" containerName="maas-api"
Jul 09 14:07:51.944680 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.944659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:51.947174 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.947155    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 14:07:51.947356 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.947337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z2qnx\""
Jul 09 14:07:51.948392 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.948371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-06548f-serving-cert\""
Jul 09 14:07:51.948515 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.948413    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 14:07:51.952551 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:51.952364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:07:52.067883 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.067850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.068052 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.067906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l569p\" (UniqueName: \"kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.068052 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.068008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.168685 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.168654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l569p\" (UniqueName: \"kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.168840 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.168712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.168840 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.168761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.168909 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:07:52.168865    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-serving-cert: secret "maas-api-e2e-shared-a-06548f-serving-cert" not found
Jul 09 14:07:52.168957 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:07:52.168941    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls podName:6ee50b25-d0d7-425a-ae5b-59b907b0a462 nodeName:}" failed. No retries permitted until 2026-07-09 14:07:52.668907333 +0000 UTC m=+2309.571969448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls") pod "maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" (UID: "6ee50b25-d0d7-425a-ae5b-59b907b0a462") : secret "maas-api-e2e-shared-a-06548f-serving-cert" not found
Jul 09 14:07:52.169441 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.169421    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.179133 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.179105    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l569p\" (UniqueName: \"kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.674052 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.674022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.676434 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.676400    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") pod \"maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.856906 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.856871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:52.998396 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:52.998372    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:07:53.000590 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:07:53.000560    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee50b25_d0d7_425a_ae5b_59b907b0a462.slice/crio-3c0ff18e368a81d1b1ec631d5e15ad5e39a897bf0c2ec6f87e52abd3bd915e38 WatchSource:0}: Error finding container 3c0ff18e368a81d1b1ec631d5e15ad5e39a897bf0c2ec6f87e52abd3bd915e38: Status 404 returned error can't find the container with id 3c0ff18e368a81d1b1ec631d5e15ad5e39a897bf0c2ec6f87e52abd3bd915e38
Jul 09 14:07:53.046456 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:53.046425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" event={"ID":"6ee50b25-d0d7-425a-ae5b-59b907b0a462","Type":"ContainerStarted","Data":"3c0ff18e368a81d1b1ec631d5e15ad5e39a897bf0c2ec6f87e52abd3bd915e38"}
Jul 09 14:07:54.051784 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:54.051745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" event={"ID":"6ee50b25-d0d7-425a-ae5b-59b907b0a462","Type":"ContainerStarted","Data":"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"}
Jul 09 14:07:54.052197 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:54.051822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:07:54.074212 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:07:54.074167    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" podStartSLOduration=2.542964763 podStartE2EDuration="3.074151937s" totalImagesPullingTime="531.187174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:07:54.073371406 +0000 UTC m=+2310.976433544" watchObservedRunningTime="2026-07-09 14:07:54.074151937 +0000 UTC m=+2310.977214073"
Jul 09 14:08:00.061491 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:08:00.061463    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:13:27.475556 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.475524    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:13:27.478776 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.478759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.481362 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.481340    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"kube-root-ca.crt\""
Jul 09 14:13:27.481362 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.481355    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"default-dockercfg-7dlfq\""
Jul 09 14:13:27.481529 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.481474    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"openshift-service-ca.crt\""
Jul 09 14:13:27.481711 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.481694    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"rate-test-model-06548f-kserve-self-signed-certs\""
Jul 09 14:13:27.490708 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.490689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:13:27.543861 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.543829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.544034 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.543941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.544034 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.544001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwc2\" (UniqueName: \"kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.544034 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.544024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.544155 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.544074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.544155 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.544143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645050 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645188 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645230 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwc2\" (UniqueName: \"kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645279 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645331 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645377 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645703 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645703 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645687    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.645864 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.645716    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.647475 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.647445    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.647597 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.647580    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.653748 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.653729    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwc2\" (UniqueName: \"kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2\") pod \"rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") " pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.788426 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.788342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:27.916826 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:27.916801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:13:27.919223 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:13:27.919193    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893417f8_7635_45e0_8833_4bf3dc53dbf7.slice/crio-36775adf91cea177e8193d911529f6da981d0865bd3e382ed5b7485fc8bf30e5 WatchSource:0}: Error finding container 36775adf91cea177e8193d911529f6da981d0865bd3e382ed5b7485fc8bf30e5: Status 404 returned error can't find the container with id 36775adf91cea177e8193d911529f6da981d0865bd3e382ed5b7485fc8bf30e5
Jul 09 14:13:28.419001 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:28.418966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" event={"ID":"893417f8-7635-45e0-8833-4bf3dc53dbf7","Type":"ContainerStarted","Data":"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"}
Jul 09 14:13:28.419001 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:28.419008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" event={"ID":"893417f8-7635-45e0-8833-4bf3dc53dbf7","Type":"ContainerStarted","Data":"36775adf91cea177e8193d911529f6da981d0865bd3e382ed5b7485fc8bf30e5"}
Jul 09 14:13:28.438014 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:28.437966    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" podStartSLOduration=1.437950552 podStartE2EDuration="1.437950552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:13:28.436566007 +0000 UTC m=+2645.339628143" watchObservedRunningTime="2026-07-09 14:13:28.437950552 +0000 UTC m=+2645.341012688"
Jul 09 14:13:37.788949 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:37.788888    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:37.788949 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:37.788959    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:37.801365 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:37.801340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:13:38.473451 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:13:38.473419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:15:18.424469 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:18.424431    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:15:33.444615 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.444550    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" podUID="893417f8-7635-45e0-8833-4bf3dc53dbf7" containerName="main" containerID="cri-o://d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b" gracePeriod=45
Jul 09 14:15:33.689679 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.689653    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:15:33.779419 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdwc2\" (UniqueName: \"kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779419 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779374    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779419 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779650 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779650 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779481    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779650 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs\") pod \"893417f8-7635-45e0-8833-4bf3dc53dbf7\" (UID: \"893417f8-7635-45e0-8833-4bf3dc53dbf7\") "
Jul 09 14:15:33.779800 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779727    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:33.779800 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779748    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache" (OuterVolumeSpecName: "model-cache") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:33.779910 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.779801    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home" (OuterVolumeSpecName: "home") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:33.781723 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.781693    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:15:33.781819 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.781727    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm" (OuterVolumeSpecName: "dshm") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:33.781819 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.781765    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2" (OuterVolumeSpecName: "kube-api-access-bdwc2") pod "893417f8-7635-45e0-8833-4bf3dc53dbf7" (UID: "893417f8-7635-45e0-8833-4bf3dc53dbf7"). InnerVolumeSpecName "kube-api-access-bdwc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:33.881116 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881084    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/893417f8-7635-45e0-8833-4bf3dc53dbf7-tls-certs\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.881116 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881112    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdwc2\" (UniqueName: \"kubernetes.io/projected/893417f8-7635-45e0-8833-4bf3dc53dbf7-kube-api-access-bdwc2\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.881299 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881142    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-tmp-dir\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.881299 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881151    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-dshm\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.881299 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881160    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-model-cache\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.881299 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.881170    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/893417f8-7635-45e0-8833-4bf3dc53dbf7-home\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:15:33.926177 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.926149    2561 generic.go:356] "Generic (PLEG): container finished" podID="893417f8-7635-45e0-8833-4bf3dc53dbf7" containerID="d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b" exitCode=0
Jul 09 14:15:33.926302 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.926192    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"
Jul 09 14:15:33.926302 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.926195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" event={"ID":"893417f8-7635-45e0-8833-4bf3dc53dbf7","Type":"ContainerDied","Data":"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"}
Jul 09 14:15:33.926302 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.926229    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4" event={"ID":"893417f8-7635-45e0-8833-4bf3dc53dbf7","Type":"ContainerDied","Data":"36775adf91cea177e8193d911529f6da981d0865bd3e382ed5b7485fc8bf30e5"}
Jul 09 14:15:33.926302 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.926247    2561 scope.go:117] "RemoveContainer" containerID="d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"
Jul 09 14:15:33.934790 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.934774    2561 scope.go:117] "RemoveContainer" containerID="d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"
Jul 09 14:15:33.935025 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:15:33.935007    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b\": container with ID starting with d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b not found: ID does not exist" containerID="d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"
Jul 09 14:15:33.935073 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.935033    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b"} err="failed to get container status \"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b\": rpc error: code = NotFound desc = could not find container \"d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b\": container with ID starting with d4654e2c61bd3a97774ac24bf6138adb0fe252a7b449fa9e16728a6e5d9bcf2b not found: ID does not exist"
Jul 09 14:15:33.948568 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.948549    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:15:33.955853 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:33.955832    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/rate-test-model-06548f-kserve-84f8bcbd9f-5m6z4"]
Jul 09 14:15:35.663038 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:15:35.663006    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893417f8-7635-45e0-8833-4bf3dc53dbf7" path="/var/lib/kubelet/pods/893417f8-7635-45e0-8833-4bf3dc53dbf7/volumes"
Jul 09 14:16:01.499616 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.499532    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:16:01.500114 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.499786    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" podUID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" containerName="maas-api" containerID="cri-o://af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb" gracePeriod=30
Jul 09 14:16:01.747763 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.747740    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:16:01.924096 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.924064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca\") pod \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") "
Jul 09 14:16:01.924277 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.924113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") pod \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") "
Jul 09 14:16:01.924277 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.924173    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l569p\" (UniqueName: \"kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p\") pod \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\" (UID: \"6ee50b25-d0d7-425a-ae5b-59b907b0a462\") "
Jul 09 14:16:01.924555 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.924522    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ee50b25-d0d7-425a-ae5b-59b907b0a462" (UID: "6ee50b25-d0d7-425a-ae5b-59b907b0a462"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:16:01.926237 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.926210    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ee50b25-d0d7-425a-ae5b-59b907b0a462" (UID: "6ee50b25-d0d7-425a-ae5b-59b907b0a462"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:16:01.926360 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:01.926336    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p" (OuterVolumeSpecName: "kube-api-access-l569p") pod "6ee50b25-d0d7-425a-ae5b-59b907b0a462" (UID: "6ee50b25-d0d7-425a-ae5b-59b907b0a462"). InnerVolumeSpecName "kube-api-access-l569p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:02.024960 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.024906    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee50b25-d0d7-425a-ae5b-59b907b0a462-openshift-service-ca\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:16:02.024960 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.024953    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee50b25-d0d7-425a-ae5b-59b907b0a462-maas-api-tls\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:16:02.024960 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.024964    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l569p\" (UniqueName: \"kubernetes.io/projected/6ee50b25-d0d7-425a-ae5b-59b907b0a462-kube-api-access-l569p\") on node \"ip-10-0-133-38.ec2.internal\" DevicePath \"\""
Jul 09 14:16:02.041021 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.040986    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" containerID="af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb" exitCode=0
Jul 09 14:16:02.041169 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.041030    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"
Jul 09 14:16:02.041169 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.041065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" event={"ID":"6ee50b25-d0d7-425a-ae5b-59b907b0a462","Type":"ContainerDied","Data":"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"}
Jul 09 14:16:02.041169 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.041118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8" event={"ID":"6ee50b25-d0d7-425a-ae5b-59b907b0a462","Type":"ContainerDied","Data":"3c0ff18e368a81d1b1ec631d5e15ad5e39a897bf0c2ec6f87e52abd3bd915e38"}
Jul 09 14:16:02.041169 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.041141    2561 scope.go:117] "RemoveContainer" containerID="af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"
Jul 09 14:16:02.050087 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.050072    2561 scope.go:117] "RemoveContainer" containerID="af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"
Jul 09 14:16:02.050338 ip-10-0-133-38 kubenswrapper[2561]: E0709 14:16:02.050319    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb\": container with ID starting with af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb not found: ID does not exist" containerID="af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"
Jul 09 14:16:02.050400 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.050351    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb"} err="failed to get container status \"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb\": rpc error: code = NotFound desc = could not find container \"af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb\": container with ID starting with af139fb2a89a738daf04fcdaae88d48baf743565ec5d4073fd36a621917445fb not found: ID does not exist"
Jul 09 14:16:02.076740 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.076719    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:16:02.079168 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:02.079147    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-06548f-866cfcb789-6j8w8"]
Jul 09 14:16:03.664182 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:03.664150    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" path="/var/lib/kubelet/pods/6ee50b25-d0d7-425a-ae5b-59b907b0a462/volumes"
Jul 09 14:16:17.143473 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:17.143438    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffc854cb6-wdgzd_ec4e199e-c402-4faa-b02d-430d0e089f1f/authorino/0.log"
Jul 09 14:16:22.763320 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:22.763285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nckn2_ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36/manager/0.log"
Jul 09 14:16:23.024251 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:23.024176    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z_83a7fcc3-9f33-4872-8ba0-1468086142a7/copy-manifests/0.log"
Jul 09 14:16:23.038467 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:23.038440    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z_83a7fcc3-9f33-4872-8ba0-1468086142a7/manager/0.log"
Jul 09 14:16:25.382243 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:25.382210    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffc854cb6-wdgzd_ec4e199e-c402-4faa-b02d-430d0e089f1f/authorino/0.log"
Jul 09 14:16:25.761254 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:25.761175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mhw9k_1a69cbd7-e2f0-4000-a71f-18ebe80f7507/kuadrant-console-plugin/0.log"
Jul 09 14:16:26.878197 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:26.878163    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-m9dl9_70c1c102-0ec1-42cb-a1a8-edda780459f1/kube-auth-proxy/0.log"
Jul 09 14:16:27.363890 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:27.363818    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2rrr_389d7b28-5562-488d-a54d-cfa390b462b1/payload-processing/0.log"
Jul 09 14:16:27.965320 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:27.965292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-k5qvr_43e23156-67cc-49e9-959a-88b891239095/main/0.log"
Jul 09 14:16:28.216013 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:28.215936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvkkr6_6e0c1c9e-5701-4365-81ec-581c17a04715/main/0.log"
Jul 09 14:16:28.478211 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:28.478137    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fhngd_91f7093f-38f2-4c7a-8857-77842326af88/main/0.log"
Jul 09 14:16:38.708966 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:38.708932    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cnqdj_51615f2c-dd92-4075-bf5f-56762d6a3dd5/global-pull-secret-syncer/0.log"
Jul 09 14:16:38.855204 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:38.855171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l2xzf_79a7a8ff-af65-4c3f-a1a8-05c8207b5897/konnectivity-agent/0.log"
Jul 09 14:16:38.929652 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:38.929624    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-38.ec2.internal_a6791fcd4f6fea18b3ec6770f8f5ef69/haproxy/0.log"
Jul 09 14:16:43.802811 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:43.802769    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffc854cb6-wdgzd_ec4e199e-c402-4faa-b02d-430d0e089f1f/authorino/0.log"
Jul 09 14:16:43.983437 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:43.983409    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mhw9k_1a69cbd7-e2f0-4000-a71f-18ebe80f7507/kuadrant-console-plugin/0.log"
Jul 09 14:16:46.817500 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:46.817470    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cnhx_6ee058d7-2b39-45e8-b109-a87f3454fc83/node-exporter/0.log"
Jul 09 14:16:46.856818 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:46.856790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cnhx_6ee058d7-2b39-45e8-b109-a87f3454fc83/kube-rbac-proxy/0.log"
Jul 09 14:16:46.894594 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:46.894572    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cnhx_6ee058d7-2b39-45e8-b109-a87f3454fc83/init-textfile/0.log"
Jul 09 14:16:48.906935 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.906886    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"]
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907197    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893417f8-7635-45e0-8833-4bf3dc53dbf7" containerName="main"
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907209    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="893417f8-7635-45e0-8833-4bf3dc53dbf7" containerName="main"
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907226    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" containerName="maas-api"
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907232    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" containerName="maas-api"
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907290    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee50b25-d0d7-425a-ae5b-59b907b0a462" containerName="maas-api"
Jul 09 14:16:48.907308 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.907297    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="893417f8-7635-45e0-8833-4bf3dc53dbf7" containerName="main"
Jul 09 14:16:48.910306 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.910283    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:48.912995 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.912975    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-snslw\"/\"default-dockercfg-x9wk4\""
Jul 09 14:16:48.913087 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.913043    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-snslw\"/\"kube-root-ca.crt\""
Jul 09 14:16:48.913087 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.913044    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-snslw\"/\"openshift-service-ca.crt\""
Jul 09 14:16:48.919985 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.919962    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"]
Jul 09 14:16:48.995300 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.995268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-lib-modules\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:48.995459 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.995307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-proc\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:48.995459 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.995336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbz6\" (UniqueName: \"kubernetes.io/projected/32b8d553-dd21-481e-b9c2-4070572a2d1d-kube-api-access-mgbz6\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:48.995459 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.995450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-sys\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:48.995611 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:48.995483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-podres\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.096729 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-lib-modules\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.096872 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-proc\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.096872 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbz6\" (UniqueName: \"kubernetes.io/projected/32b8d553-dd21-481e-b9c2-4070572a2d1d-kube-api-access-mgbz6\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.096872 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096843    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-proc\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.097041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096877    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-lib-modules\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.097041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-sys\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.097041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096954    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-sys\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.097041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.096954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-podres\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.097164 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.097040    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b8d553-dd21-481e-b9c2-4070572a2d1d-podres\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.107458 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.107435    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbz6\" (UniqueName: \"kubernetes.io/projected/32b8d553-dd21-481e-b9c2-4070572a2d1d-kube-api-access-mgbz6\") pod \"perf-node-gather-daemonset-zd7t6\" (UID: \"32b8d553-dd21-481e-b9c2-4070572a2d1d\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.221052 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.220959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:49.351041 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.351013    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"]
Jul 09 14:16:49.353632 ip-10-0-133-38 kubenswrapper[2561]: W0709 14:16:49.353606    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod32b8d553_dd21_481e_b9c2_4070572a2d1d.slice/crio-5e5ccbefe68dfb86ee19342b74da0131bd4cfe043da1f16ae43e57f70baf1020 WatchSource:0}: Error finding container 5e5ccbefe68dfb86ee19342b74da0131bd4cfe043da1f16ae43e57f70baf1020: Status 404 returned error can't find the container with id 5e5ccbefe68dfb86ee19342b74da0131bd4cfe043da1f16ae43e57f70baf1020
Jul 09 14:16:49.403118 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:49.403097    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-2bxsn_3c454f18-d674-41b0-99d5-903d5e26f151/networking-console-plugin/0.log"
Jul 09 14:16:50.235433 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:50.235397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6" event={"ID":"32b8d553-dd21-481e-b9c2-4070572a2d1d","Type":"ContainerStarted","Data":"e3d559cf2b4d72c77a9435b5c69684310f362a7902d7bf6f0577343b76ad03d7"}
Jul 09 14:16:50.235809 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:50.235453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6" event={"ID":"32b8d553-dd21-481e-b9c2-4070572a2d1d","Type":"ContainerStarted","Data":"5e5ccbefe68dfb86ee19342b74da0131bd4cfe043da1f16ae43e57f70baf1020"}
Jul 09 14:16:50.235809 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:50.235557    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:50.253619 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:50.253565    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6" podStartSLOduration=2.253550087 podStartE2EDuration="2.253550087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:16:50.252094602 +0000 UTC m=+2847.155156940" watchObservedRunningTime="2026-07-09 14:16:50.253550087 +0000 UTC m=+2847.156612224"
Jul 09 14:16:52.418457 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:52.418427    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlkbv_6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55/dns/0.log"
Jul 09 14:16:52.444137 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:52.444109    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlkbv_6c2e08ad-cc3c-4b2f-8e56-1c71c8807b55/kube-rbac-proxy/0.log"
Jul 09 14:16:52.474164 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:52.474143    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqpvs_4081e60e-7482-4c9a-8bb0-3275d8acb4a3/dns-node-resolver/0.log"
Jul 09 14:16:53.112593 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:53.112557    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d6f69d4b7-hgg8w_ea2cd02c-c142-4d31-815d-035c5d3a0ff3/registry/0.log"
Jul 09 14:16:53.194610 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:53.194566    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6wxt_cf747d62-8793-4599-89b4-88000c3f56e6/node-ca/0.log"
Jul 09 14:16:54.469856 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:54.469827    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-m9dl9_70c1c102-0ec1-42cb-a1a8-edda780459f1/kube-auth-proxy/0.log"
Jul 09 14:16:54.703080 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:54.703053    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2rrr_389d7b28-5562-488d-a54d-cfa390b462b1/payload-processing/0.log"
Jul 09 14:16:55.466006 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:55.465980    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnrxq_cb1a6d5d-eddb-4f5e-b53d-12fc2c7a53ad/serve-healthcheck-canary/0.log"
Jul 09 14:16:56.082103 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:56.082072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glqs9_70e09dc8-2041-40a5-8610-7ed472e3a9e6/kube-rbac-proxy/0.log"
Jul 09 14:16:56.109660 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:56.109641    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glqs9_70e09dc8-2041-40a5-8610-7ed472e3a9e6/exporter/0.log"
Jul 09 14:16:56.135244 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:56.135227    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glqs9_70e09dc8-2041-40a5-8610-7ed472e3a9e6/extractor/0.log"
Jul 09 14:16:56.249900 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:56.249876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-zd7t6"
Jul 09 14:16:59.170656 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:59.170630    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nckn2_ad6c6c11-2c2d-45d0-ae1e-98e1f6806b36/manager/0.log"
Jul 09 14:16:59.303022 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:59.302993    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-m9dl9_70c1c102-0ec1-42cb-a1a8-edda780459f1/kube-auth-proxy/0.log"
Jul 09 14:16:59.315265 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:59.315240    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z_83a7fcc3-9f33-4872-8ba0-1468086142a7/manager/0.log"
Jul 09 14:16:59.336983 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:59.336960    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-9nb9z_83a7fcc3-9f33-4872-8ba0-1468086142a7/copy-manifests/0.log"
Jul 09 14:16:59.479458 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:16:59.479428    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2rrr_389d7b28-5562-488d-a54d-cfa390b462b1/payload-processing/0.log"
Jul 09 14:17:00.802123 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:17:00.802058    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7769c579dd-frq5h_05cbb653-e313-47fa-b57a-d6ffc0f0e580/manager/0.log"
Jul 09 14:17:01.152690 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:17:01.152661    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-m9dl9_70c1c102-0ec1-42cb-a1a8-edda780459f1/kube-auth-proxy/0.log"
Jul 09 14:17:01.338235 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:17:01.338204    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2rrr_389d7b28-5562-488d-a54d-cfa390b462b1/payload-processing/0.log"
Jul 09 14:17:05.885738 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:17:05.885696    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-sf2t4_f1250926-d1b6-4466-a474-50c76eb07122/migrator/0.log"
Jul 09 14:17:05.913861 ip-10-0-133-38 kubenswrapper[2561]: I0709 14:17:05.913833    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-sf2t4_f1250926-d1b6-4466-a474-50c76eb07122/graceful-termination/0.log"