Jul 06 23:41:19.480969 ip-10-0-133-246 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 23:41:19.480983 ip-10-0-133-246 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 23:41:19.480993 ip-10-0-133-246 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 23:41:19.481304 ip-10-0-133-246 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 23:41:29.690692 ip-10-0-133-246 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 23:41:29.690707 ip-10-0-133-246 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 57fed1fadab747a8912410bf6e27c004 --
Jul 06 23:43:21.945305 ip-10-0-133-246 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:43:22.380535 ip-10-0-133-246 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:43:22.380535 ip-10-0-133-246 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:43:22.380535 ip-10-0-133-246 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:43:22.380535 ip-10-0-133-246 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:43:22.380535 ip-10-0-133-246 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:43:22.381473 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.381378    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:43:22.385460 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385444    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.385460 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385460    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385465    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385468    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385472    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385477    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385481    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385484    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385487    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385491    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385494    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385508    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385512    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385515    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385517    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385520    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385523    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385526    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385528    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385531    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385534    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.385540 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385536    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385539    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385541    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385545    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385554    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385557    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385559    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385562    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385564    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385567    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385569    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385572    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385574    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385577    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385579    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385581    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385584    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385587    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385590    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385594    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.386009 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385597    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385599    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385602    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385604    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385607    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385609    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385612    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385615    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385617    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385619    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385622    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385626    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385629    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385632    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385635    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385638    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385640    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385643    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385645    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385648    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.386511 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385650    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385655    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385658    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385661    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385663    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385666    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385669    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385672    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385674    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385677    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385679    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385682    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385684    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385687    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385690    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385692    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385701    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385704    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385706    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385709    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.387027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385712    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385714    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385717    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385719    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385722    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385725    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385727    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385730    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385733    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385735    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385738    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385740    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385743    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385745    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385748    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385750    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385753    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.385756    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386564    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.387493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386572    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386575    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386578    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386581    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386584    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386587    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386589    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386592    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386594    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386597    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386601    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386603    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386606    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386609    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386611    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386614    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386618    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386622    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386626    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386629    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.387989 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386632    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386635    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386637    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386640    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386643    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386646    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386648    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386651    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386653    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386656    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386659    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386661    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386663    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386666    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386668    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386671    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386673    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386676    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386678    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.388477 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386683    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386686    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386688    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386691    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386694    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386696    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386699    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386701    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386705    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386709    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386713    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386716    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386719    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386722    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386725    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386727    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386730    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386733    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386735    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.389005 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386738    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386741    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386743    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386746    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386748    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386751    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386753    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386757    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386760    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386763    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386766    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386769    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386771    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386774    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386777    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386780    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386782    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386785    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386788    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.389467 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386791    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386794    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386796    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386799    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386802    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386805    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386807    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386810    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386813    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386815    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386818    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386820    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386823    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386825    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386828    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386830    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386833    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386835    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386838    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.386841    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.389969 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387246    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387251    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387254    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387256    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387259    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387262    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387265    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387267    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387270    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387273    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387276    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387278    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387283    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387287    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387289    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387293    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387296    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387298    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387301    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387304    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.390447 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387307    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387309    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387312    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387314    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387317    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387319    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387322    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387325    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387327    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387330    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387332    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387335    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387337    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387340    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387342    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387345    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387350    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387352    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387355    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387358    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.390940 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387360    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387363    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387365    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387368    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387371    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387373    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387376    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387378    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387381    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387383    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387386    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387388    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387391    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387393    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387395    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387398    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387400    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387403    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387406    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.391426 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387408    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387412    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387414    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387417    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387419    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387422    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387424    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387426    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387429    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387434    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387437    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387440    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387442    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387445    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387447    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387450    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387452    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387455    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387458    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387461    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.391889 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387465    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387468    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387470    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387472    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387475    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387477    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387481    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387484    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387487    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387490    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387493    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387511    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387514    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387517    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387520    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387523    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387525    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387528    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387530    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.387533    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.392355 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387602    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387610    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387616    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387621    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387625    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387628    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387632    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387636    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387639    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387642    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387647    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387650    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387653    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387656    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387659    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387662    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387665    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387668    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387672    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387675    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387678    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387681    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387684    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387689    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:43:22.392835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387692    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387695    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387698    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387701    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387704    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387707    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387710    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387713    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387717    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387720    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387723    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387726    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387729    2580 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387732    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387736    2580 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387739    2580 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387742    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387745    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387748    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387753    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387756    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387759    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387761    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387764    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387767    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:43:22.393398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387770    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387772    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387775    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387778    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387781    2580 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387785    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387789    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387792    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387795    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387798    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387801    2580 flags.go:64] FLAG: --help="false"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387804    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387807    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387810    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387813    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387816    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387820    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387823    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387826    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387829    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387832    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387835    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387838    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387840    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:43:22.394028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387843    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387846    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387849    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387852    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387855    2580 flags.go:64] FLAG: --lock-file=""
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387858    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387860    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387863    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387868    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387871    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387874    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387876    2580 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387879    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387883    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387887    2580 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387889    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387894    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387897    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387901    2580 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387903    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387906    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387910    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387913    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387915    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387918    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:43:22.394623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387921    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387928    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387931    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387934    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387937    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387940    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387946    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387949    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387952    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387955    2580 flags.go:64] FLAG: --port="10250"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387958    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387961    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb45f88486c77f1e"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387964    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387967    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387970    2580 flags.go:64] FLAG: --register-node="true"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387972    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387976    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387979    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387981    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387984    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387988    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387992    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387995    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.387998    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388001    2580 flags.go:64] FLAG: --runonce="false"
Jul 06 23:43:22.395629 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388004    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388007    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388010    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388012    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388015    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388018    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388023    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388026    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388029    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388032    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388035    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388037    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388040    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388043    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388046    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388051    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388054    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388057    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388061    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388064    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388067    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388070    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388073    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388075    2580 flags.go:64] FLAG: --v="2"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388079    2580 flags.go:64] FLAG: --version="false"
Jul 06 23:43:22.396672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388083    2580 flags.go:64] FLAG: --vmodule=""
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388086    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.388090    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388198    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388202    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388205    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388208    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388211    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388214    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388217    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388219    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388222    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388224    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388228    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388231    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388234    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388236    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388239    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388241    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.397740 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388244    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388247    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388250    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388252    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388255    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388257    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388260    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388263    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388266    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388271    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388274    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388277    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388279    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388282    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388285    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388288    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388292    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388295    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388298    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.398600 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388302    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388306    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388309    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388312    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388315    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388318    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388321    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388325    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388328    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388330    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388333    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388335    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388338    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388341    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388344    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388346    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388349    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388351    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388354    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388356    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.399232 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388359    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388361    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388364    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388367    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388369    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388372    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388375    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388377    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388379    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388384    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388388    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388391    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388394    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388397    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388400    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388402    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388405    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388407    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388410    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.400043 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388414    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388416    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388419    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388422    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388424    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388427    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388429    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388432    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388434    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388437    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388439    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388442    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388445    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388447    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388450    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388452    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388455    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388458    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388460    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388463    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388465    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.400853 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388468    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388472    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388475    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.388477    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.389214    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.397379    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.397399    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.397426    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.397434    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397553    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397562    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397567    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397572    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397577    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397581    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.401401 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397586    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397590    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397594    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397599    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397603    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397607    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397611    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397616    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397620    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397626    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397632    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397638    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397642    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397647    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397651    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397656    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397661    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397665    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397671    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.402031 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397675    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397680    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397684    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397689    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397696    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397701    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397706    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397710    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397715    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397719    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397723    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397727    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397734    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397739    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397744    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397748    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397752    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397757    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397761    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397765    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.402552 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397769    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397774    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397778    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397782    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397787    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397791    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397795    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397799    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397803    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397816    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397820    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397824    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397828    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397832    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397836    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397841    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397846    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397851    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397855    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397859    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.403136 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397862    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397866    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397871    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397875    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397879    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397883    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397887    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397891    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397895    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397899    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397903    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397908    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397912    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397916    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397920    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397924    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397929    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397933    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397939    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.403785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397945    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397949    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397953    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397957    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397961    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397965    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397970    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397974    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397978    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397982    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397986    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397991    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.397995    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398000    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398004    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.404315 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.398012    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398233    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398243    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398248    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398253    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398257    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398264    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398271    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398276    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398280    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398285    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398289    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398293    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398297    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398302    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398306    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398311    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398315    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398321    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:43:22.404722 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398327    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398332    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398336    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398341    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398345    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398350    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398355    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398360    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398364    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398368    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398373    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398377    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398381    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398386    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398390    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398394    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398398    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398403    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398407    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398411    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:43:22.405212 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398415    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398419    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398423    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398427    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398431    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398435    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398439    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398443    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398448    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398452    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398457    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398461    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398467    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398472    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398477    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398481    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398485    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398490    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398511    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:43:22.405751 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398516    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398520    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398525    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398529    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398534    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398538    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398542    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398546    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398550    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398554    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398558    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398562    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398567    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398571    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398575    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398580    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398584    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398589    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398593    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398597    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:43:22.406561 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398601    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398605    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398609    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398613    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398617    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398621    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398625    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398629    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398634    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398638    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398642    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398647    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398652    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398656    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398660    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398664    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398668    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398674    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398679    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398683    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:43:22.407134 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398687    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:22.398691    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.398700    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.398864    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.401592    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.403294    2580 server.go:1019] "Starting client certificate rotation"
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.403397    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.404245    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:43:22.407716 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.406326    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:43:22.412205 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.412184    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:43:22.426089 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.426065    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:43:22.429157 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.429139    2580 log.go:25] "Validated CRI v1 image API"
Jul 06 23:43:22.430080 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.430065    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:43:22.433641 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.433626    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:43:22.435750 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.435723    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c9dbb050-0a40-4fe1-bf4b-d8a0c96e1834:/dev/nvme0n1p4 d9eab586-130d-4310-8771-8c3d0ba18b56:/dev/nvme0n1p3]
Jul 06 23:43:22.435818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.435749    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:43:22.441649 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.441539    2580 manager.go:216] Machine: {Timestamp:2026-07-06 23:43:22.440159158 +0000 UTC m=+0.369134932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3030362 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2014a73808655e2c7478864f2691cb SystemUUID:ec2014a7-3808-655e-2c74-78864f2691cb BootID:57fed1fa-dab7-47a8-9124-10bf6e27c004 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:37:95:99:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:37:95:99:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:f9:ae:49:ce:03 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:43:22.441649 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.441642    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:43:22.441745 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.441729    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:43:22.445304 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.445278    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:43:22.445452 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.445310    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:43:22.446791 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.446779    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:43:22.446829 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.446794    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:43:22.446829 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.446802    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:43:22.447469 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.447458    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:43:22.448892 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.448882    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:43:22.452037 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452025    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:43:22.452210 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452199    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:43:22.452242 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452235    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:43:22.452271 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452258    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:43:22.452303 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452286    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:43:22.452333 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452312    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:43:22.452333 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452330    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:43:22.452987 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.452956    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:43:22.453068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.453004    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:43:22.455534 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.455509    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:43:22.457943 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.457928    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:43:22.458000 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.457961    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:43:22.458496 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.458470    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-htfrc"
Jul 06 23:43:22.459162 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459148    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:43:22.459222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459173    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:43:22.459222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459184    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:43:22.459222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459194    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:43:22.459222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459205    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:43:22.459222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459213    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459227    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459233    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459240    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459246    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459255    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:43:22.459371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459261    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:43:22.459995 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.459983    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:43:22.460038 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.460002    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:43:22.464498 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.464466    2580 server.go:1268] "Started kubelet"
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.465069    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.465240    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.465242    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.465537    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.465723    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:43:22.465967 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.465858    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:43:22.465822 ip-10-0-133-246 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:43:22.466831 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.466655    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-htfrc"
Jul 06 23:43:22.467499 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.467473    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:43:22.468280 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.468265    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:43:22.474663 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.474643    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:43:22.474957 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.474940    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:43:22.475059 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.474941    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:43:22.475113 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.475032    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.475772 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475743    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:43:22.475772 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475743    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:43:22.475772 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475773    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:43:22.475940 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475890    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:43:22.475940 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475898    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:43:22.475940 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475915    2580 factory.go:55] Registering systemd factory
Jul 06 23:43:22.475940 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.475929    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:43:22.476276 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476257    2580 factory.go:153] Registering CRI-O factory
Jul 06 23:43:22.476276 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476278    2580 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:43:22.476439 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476338    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:43:22.476439 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476366    2580 factory.go:103] Registering Raw factory
Jul 06 23:43:22.476439 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476383    2580 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:43:22.477000 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.475677    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-246.ec2.internal.18bfd7efd0ec982d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-246.ec2.internal,UID:ip-10-0-133-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-246.ec2.internal,},FirstTimestamp:2026-07-06 23:43:22.464327725 +0000 UTC m=+0.393303503,LastTimestamp:2026-07-06 23:43:22.464327725 +0000 UTC m=+0.393303503,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-246.ec2.internal,}"
Jul 06 23:43:22.477000 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.476852    2580 manager.go:349] Starting recovery of all containers
Jul 06 23:43:22.480885 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.480842    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:22.483669 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.483434    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-246.ec2.internal\" not found" node="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.484724 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.484670    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:43:22.488906 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.488857    2580 manager.go:354] Recovery completed
Jul 06 23:43:22.493518 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.493504    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.495804 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.495789    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.495858 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.495818    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.495858 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.495829    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.496421 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.496407    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:43:22.496471 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.496422    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:43:22.496471 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.496443    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:43:22.496584 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.496411    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.497230 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497210    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.497304 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497246    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.497304 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497259    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.497758 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497746    2580 policy_none.go:49] "None policy: Start"
Jul 06 23:43:22.497806 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497763    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:43:22.497806 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.497774    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:43:22.498736 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.498725    2580 policy_none.go:47] "Start"
Jul 06 23:43:22.547249 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547225    2580 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:43:22.547366 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.547277    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:43:22.547366 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547292    2580 server.go:87] "Starting device plugin registration server"
Jul 06 23:43:22.547603 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547589    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:43:22.547679 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547605    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:43:22.547736 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547704    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:43:22.547804 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547785    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:43:22.547857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.547806    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:43:22.548375 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.548342    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:43:22.548451 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.548395    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.618667 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.618634    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:43:22.619835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.618680    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:43:22.619835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.618704    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:43:22.619835 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.618743    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:43:22.621040 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.621024    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:22.648720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.648654    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.649600 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.649577    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.649671 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.649613    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.649671 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.649623    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.649671 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.649654    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.658839 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.658819    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.658919 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.658842    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-246.ec2.internal\": node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.672345 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.672322    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.721942 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.721903    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"]
Jul 06 23:43:22.722030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.721985    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.723865 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.723851    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.723923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.723879    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.723923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.723891    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.725177 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.725165    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.725301 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.725284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.725357 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.725317    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.726151 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726133    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.726229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726160    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.726229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726172    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.726229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726197    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.726229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726217    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.726229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.726228    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.727362 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.727345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.727499 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.727371    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:43:22.728446 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.728427    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:43:22.728553 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.728464    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:43:22.728553 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.728481    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:43:22.754292 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.754269    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-246.ec2.internal\" not found" node="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.758891 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.758874    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-246.ec2.internal\" not found" node="ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.772807 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.772791    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.776919 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.776903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.776992 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.776927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.776992 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.776947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88d80e9c047815a47898056b987d8c55-config\") pod \"kube-apiserver-proxy-ip-10-0-133-246.ec2.internal\" (UID: \"88d80e9c047815a47898056b987d8c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.875417 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.875380    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:22.877788 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.877859 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.877859 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88d80e9c047815a47898056b987d8c55-config\") pod \"kube-apiserver-proxy-ip-10-0-133-246.ec2.internal\" (UID: \"88d80e9c047815a47898056b987d8c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.877953 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877904    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.878010 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877985    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88d80e9c047815a47898056b987d8c55-config\") pod \"kube-apiserver-proxy-ip-10-0-133-246.ec2.internal\" (UID: \"88d80e9c047815a47898056b987d8c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.878057 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:22.877998    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee61f1804b3b1a7302129f8aa73fffa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal\" (UID: \"ee61f1804b3b1a7302129f8aa73fffa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:22.976679 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:22.976601    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:23.063512 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.063488    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:23.063627 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.063579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:23.077731 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.077710    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:23.178314 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.178258    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:23.279473 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.279405    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:23.380031 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.379996    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-246.ec2.internal\" not found"
Jul 06 23:43:23.402579 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.402550    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:43:23.403056 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.402729    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:43:23.403056 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.402730    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:43:23.419599 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.419572    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:23.453913 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.453875    2580 apiserver.go:52] "Watching apiserver"
Jul 06 23:43:23.465998 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.465973    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:43:23.467944 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.467921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-kf45g","openshift-multus/multus-additional-cni-plugins-nl95z","openshift-network-diagnostics/network-check-target-rtlbp","openshift-ovn-kubernetes/ovnkube-node-wtrpv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg","openshift-cluster-node-tuning-operator/tuned-9qgm2","openshift-dns/node-resolver-dw97x","openshift-multus/multus-sc8c8","openshift-multus/network-metrics-daemon-976vc","openshift-network-operator/iptables-alerter-r58hn","kube-system/global-pull-secret-syncer-b8l9p","kube-system/konnectivity-agent-qmrpq"]
Jul 06 23:43:23.469453 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.469433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.470585 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.470563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.472960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.472901    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:38:23 +0000 UTC" deadline="2028-01-12 20:17:43.997505814 +0000 UTC"
Jul 06 23:43:23.473047 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.472961    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13316h34m20.524552334s"
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473476    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473492    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.473552    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473570    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xgb5z\""
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473493    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.473720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473702    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:43:23.474068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473727    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.474068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:43:23.474068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.473878    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:43:23.474068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.474039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sv9ks\""
Jul 06 23:43:23.474237 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.474096    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.474987 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.474969    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.475174 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.475157    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:43:23.475246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.475171    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:23.476212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.476194    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.477513 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477482    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:43:23.477670 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477639    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.477763 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477669    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:43:23.477829 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.477888 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:43:23.477888 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:43:23.477998 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.477912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.478192 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.478178    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6qttn\""
Jul 06 23:43:23.478504 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.478492    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:43:23.478854 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.478826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.478854 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.478841    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.478982 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.478899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k47kl\""
Jul 06 23:43:23.479219 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.479203    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.480596 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.480575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.480696 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.480640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.480696 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.480658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.480988 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.480949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jgwlf\""
Jul 06 23:43:23.481597 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.481578    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.481741 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.481725    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.481879 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.481841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qpv7j\""
Jul 06 23:43:23.481954 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.481942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.482024 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.482008    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:23.482635 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-registration-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.482718 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-system-cni-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.482718 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.482795 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:23.482795 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-etc-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.482909 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9729338b-710d-496c-9bd9-e890fa7f1247-ovn-node-metrics-cert\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.482909 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-socket-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.482909 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.482909 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-sys-fs\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.482909 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-host\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-serviceca\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p6s7\" (UniqueName: \"kubernetes.io/projected/026dd1c0-6780-4ec9-8386-48ba21752458-kube-api-access-7p6s7\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-netd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.482994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-env-overrides\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-script-lib\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-device-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq49x\" (UniqueName: \"kubernetes.io/projected/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kube-api-access-wq49x\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-os-release\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-binary-copy\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.483212 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-node-log\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483239    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p8dfq\""
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483246    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-bin\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-config\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qn4r\" (UniqueName: \"kubernetes.io/projected/9729338b-710d-496c-9bd9-e890fa7f1247-kube-api-access-5qn4r\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-netns\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6pzt\" (UniqueName: \"kubernetes.io/projected/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-kube-api-access-f6pzt\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-kubelet\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-systemd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-var-lib-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.483857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-ovn\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.484618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-log-socket\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.484618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-cnibin\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.484618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-systemd-units\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.484618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.483823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-slash\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.485345 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.485088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.485345 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.485154    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:23.485853 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.485831    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:43:23.486122 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.486093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kwfhg\""
Jul 06 23:43:23.486632 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.486614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.487023 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.487000    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:43:23.489546 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.487173    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:43:23.490178 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:43:23.490371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:43:23.490465 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490394    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xz4w7\""
Jul 06 23:43:23.490809 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490772    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:43:23.490903 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490828    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:43:23.490903 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.490861    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"
Jul 06 23:43:23.491085 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.491069    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal"]
Jul 06 23:43:23.499633 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.499615    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:43:23.499744 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.499730    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal"]
Jul 06 23:43:23.514506 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.514490    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6g4w"
Jul 06 23:43:23.522853 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.522833    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6g4w"
Jul 06 23:43:23.576674 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.576633    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:43:23.583961 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.583938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-env-overrides\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.583961 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.583964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-script-lib\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.583982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-os-release\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.583998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-binary-copy\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-lib-modules\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ddfd87-2969-4743-995f-1ac87fd3ac53-host-slash\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdn7n\" (UniqueName: \"kubernetes.io/projected/91ddfd87-2969-4743-995f-1ac87fd3ac53-kube-api-access-fdn7n\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.584188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-multus-certs\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnwx\" (UniqueName: \"kubernetes.io/projected/f2faa5c3-72a7-4604-a6a4-aec505d0e481-kube-api-access-5vnwx\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-kubelet-config\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584240    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-os-release\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgk5t\" (UniqueName: \"kubernetes.io/projected/74f81e1e-90e7-4702-845f-d6a1608bc0b5-kube-api-access-lgk5t\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-node-log\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cni-binary-copy\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-k8s-cni-cncf-io\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584355    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-node-log\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-multus\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-etc-kubernetes\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbb5f\" (UniqueName: \"kubernetes.io/projected/faefef84-7e31-4ba4-9477-713951e7d3f1-kube-api-access-kbb5f\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-modprobe-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qn4r\" (UniqueName: \"kubernetes.io/projected/9729338b-710d-496c-9bd9-e890fa7f1247-kube-api-access-5qn4r\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.584574 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-tmp\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-netns\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-netns\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np55p\" (UniqueName: \"kubernetes.io/projected/77de6403-df73-40b9-932f-c253c2817424-kube-api-access-np55p\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd18c354-7ccf-493c-b2c2-cf4faa238f15-konnectivity-ca\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584751    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-kubelet\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584755    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-script-lib\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584807    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-binary-copy\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584597    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-env-overrides\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584822    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-kubelet\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-netns\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-systemd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584907    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-systemd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-var-lib-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.584990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-ovn\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585017    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-var-lib-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.585176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-log-socket\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585067    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-log-socket\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585101    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-ovn\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-cnibin\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-host\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585158    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-cnibin\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-slash\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-registration-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585228    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-slash\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-socket-dir-parent\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysconfig\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-conf\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585334    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-registration-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd18c354-7ccf-493c-b2c2-cf4faa238f15-agent-certs\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-daemon-config\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-bin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.586081 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-socket-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-sys-fs\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6s7\" (UniqueName: \"kubernetes.io/projected/026dd1c0-6780-4ec9-8386-48ba21752458-kube-api-access-7p6s7\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-netd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-device-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq49x\" (UniqueName: \"kubernetes.io/projected/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kube-api-access-wq49x\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585633    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-socket-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585648    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-sys-fs\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-device-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-netd\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77de6403-df73-40b9-932f-c253c2817424-hosts-file\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585827    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-os-release\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-run\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.585970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-bin\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.586818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-config\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586065    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586073    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-cni-bin\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-system-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586135    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-systemd\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-conf-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-dbus\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-var-lib-kubelet\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77de6403-df73-40b9-932f-c253c2817424-tmp-dir\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91ddfd87-2969-4743-995f-1ac87fd3ac53-iptables-alerter-script\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586358    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.587402 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586398    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586369    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-run-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6pzt\" (UniqueName: \"kubernetes.io/projected/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-kube-api-access-f6pzt\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-kubelet\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-sys\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-hostroot\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-tuned\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-systemd-units\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-system-cni-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586649    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-systemd-units\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586664    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9729338b-710d-496c-9bd9-e890fa7f1247-ovnkube-config\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586676    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026dd1c0-6780-4ec9-8386-48ba21752458-system-cni-dir\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cnibin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.587997 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-etc-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9729338b-710d-496c-9bd9-e890fa7f1247-ovn-node-metrics-cert\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-host\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-serviceca\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-kubernetes\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586876    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-host\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.586902    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9729338b-710d-496c-9bd9-e890fa7f1247-etc-openvswitch\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.587127    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026dd1c0-6780-4ec9-8386-48ba21752458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.587166    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:43:23.588593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.587214    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-serviceca\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.590277 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.590255    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9729338b-710d-496c-9bd9-e890fa7f1247-ovn-node-metrics-cert\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.595305 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.595215    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:23.595305 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.595239    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:23.595305 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.595252    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:23.596796 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.596775    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.09673296 +0000 UTC m=+2.025708748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:23.597973 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.597945    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6pzt\" (UniqueName: \"kubernetes.io/projected/5e61d95b-ccd9-42cc-bf00-1a9b486610d0-kube-api-access-f6pzt\") pod \"node-ca-kf45g\" (UID: \"5e61d95b-ccd9-42cc-bf00-1a9b486610d0\") " pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.598409 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.598384    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq49x\" (UniqueName: \"kubernetes.io/projected/92c9b6e3-74f6-4f86-a6a4-cd69498703fd-kube-api-access-wq49x\") pod \"aws-ebs-csi-driver-node-gp5rg\" (UID: \"92c9b6e3-74f6-4f86-a6a4-cd69498703fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.599020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.598981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qn4r\" (UniqueName: \"kubernetes.io/projected/9729338b-710d-496c-9bd9-e890fa7f1247-kube-api-access-5qn4r\") pod \"ovnkube-node-wtrpv\" (UID: \"9729338b-710d-496c-9bd9-e890fa7f1247\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.600206 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.600187    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p6s7\" (UniqueName: \"kubernetes.io/projected/026dd1c0-6780-4ec9-8386-48ba21752458-kube-api-access-7p6s7\") pod \"multus-additional-cni-plugins-nl95z\" (UID: \"026dd1c0-6780-4ec9-8386-48ba21752458\") " pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.687125 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cni-binary-copy\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-k8s-cni-cncf-io\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-multus\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-etc-kubernetes\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbb5f\" (UniqueName: \"kubernetes.io/projected/faefef84-7e31-4ba4-9477-713951e7d3f1-kube-api-access-kbb5f\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-modprobe-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687234    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-k8s-cni-cncf-io\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687260    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-etc-kubernetes\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687261    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-multus\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-tmp\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-netns\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687359    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-modprobe-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np55p\" (UniqueName: \"kubernetes.io/projected/77de6403-df73-40b9-932f-c253c2817424-kube-api-access-np55p\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd18c354-7ccf-493c-b2c2-cf4faa238f15-konnectivity-ca\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687413    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-netns\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-host\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-socket-dir-parent\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysconfig\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-conf\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd18c354-7ccf-493c-b2c2-cf4faa238f15-agent-certs\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-daemon-config\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-bin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687642    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysconfig\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77de6403-df73-40b9-932f-c253c2817424-hosts-file\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-os-release\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687706    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77de6403-df73-40b9-932f-c253c2817424-hosts-file\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-run\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-system-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.687947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687779    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cni-binary-copy\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-systemd\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-conf-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-dbus\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687904    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-conf\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-var-lib-kubelet\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77de6403-df73-40b9-932f-c253c2817424-tmp-dir\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687959    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-system-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.687971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91ddfd87-2969-4743-995f-1ac87fd3ac53-iptables-alerter-script\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-host\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-kubelet\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688044    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd18c354-7ccf-493c-b2c2-cf4faa238f15-konnectivity-ca\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688045    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-kubelet\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-sys\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688095    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-cni-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.688958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-hostroot\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688119    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-os-release\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688118    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-socket-dir-parent\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-tuned\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.688182    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.688194    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688212    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-daemon-config\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688219    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-multus-conf-dir\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-dbus\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.688259    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.188239633 +0000 UTC m=+2.117215428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688267    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-var-lib-cni-bin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688274    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-run\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688278    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-var-lib-kubelet\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688276    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-sysctl-d\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688312    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-systemd\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688333    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-sys\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.689848 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-hostroot\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.688424    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.188407245 +0000 UTC m=+2.117383013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cnibin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-kubernetes\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-lib-modules\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ddfd87-2969-4743-995f-1ac87fd3ac53-host-slash\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdn7n\" (UniqueName: \"kubernetes.io/projected/91ddfd87-2969-4743-995f-1ac87fd3ac53-kube-api-access-fdn7n\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-multus-certs\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnwx\" (UniqueName: \"kubernetes.io/projected/f2faa5c3-72a7-4604-a6a4-aec505d0e481-kube-api-access-5vnwx\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-kubelet-config\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688565    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77de6403-df73-40b9-932f-c253c2817424-tmp-dir\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgk5t\" (UniqueName: \"kubernetes.io/projected/74f81e1e-90e7-4702-845f-d6a1608bc0b5-kube-api-access-lgk5t\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688639    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ddfd87-2969-4743-995f-1ac87fd3ac53-host-slash\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688674    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-cnibin\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688710    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-kubernetes\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688792    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f81e1e-90e7-4702-845f-d6a1608bc0b5-lib-modules\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688843    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2faa5c3-72a7-4604-a6a4-aec505d0e481-host-run-multus-certs\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.690365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688887    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91ddfd87-2969-4743-995f-1ac87fd3ac53-iptables-alerter-script\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.690951 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.688965    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13026d5d-808c-48f5-bc32-791a316445d5-kubelet-config\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:23.690951 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.689937    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-tmp\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.690951 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.690397    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f81e1e-90e7-4702-845f-d6a1608bc0b5-etc-tuned\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.691053 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.690978    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd18c354-7ccf-493c-b2c2-cf4faa238f15-agent-certs\") pod \"konnectivity-agent-qmrpq\" (UID: \"dd18c354-7ccf-493c-b2c2-cf4faa238f15\") " pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.697971 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.697938    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np55p\" (UniqueName: \"kubernetes.io/projected/77de6403-df73-40b9-932f-c253c2817424-kube-api-access-np55p\") pod \"node-resolver-dw97x\" (UID: \"77de6403-df73-40b9-932f-c253c2817424\") " pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.698082 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.697991    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnwx\" (UniqueName: \"kubernetes.io/projected/f2faa5c3-72a7-4604-a6a4-aec505d0e481-kube-api-access-5vnwx\") pod \"multus-sc8c8\" (UID: \"f2faa5c3-72a7-4604-a6a4-aec505d0e481\") " pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.698082 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.698024    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbb5f\" (UniqueName: \"kubernetes.io/projected/faefef84-7e31-4ba4-9477-713951e7d3f1-kube-api-access-kbb5f\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:23.698182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.698163    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgk5t\" (UniqueName: \"kubernetes.io/projected/74f81e1e-90e7-4702-845f-d6a1608bc0b5-kube-api-access-lgk5t\") pod \"tuned-9qgm2\" (UID: \"74f81e1e-90e7-4702-845f-d6a1608bc0b5\") " pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.698311 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.698295    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdn7n\" (UniqueName: \"kubernetes.io/projected/91ddfd87-2969-4743-995f-1ac87fd3ac53-kube-api-access-fdn7n\") pod \"iptables-alerter-r58hn\" (UID: \"91ddfd87-2969-4743-995f-1ac87fd3ac53\") " pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.745735 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.745702    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee61f1804b3b1a7302129f8aa73fffa7.slice/crio-6ff0eb48e22ca11041b99dddcbdbd287832dc4daee962921e30d310dcecd6429 WatchSource:0}: Error finding container 6ff0eb48e22ca11041b99dddcbdbd287832dc4daee962921e30d310dcecd6429: Status 404 returned error can't find the container with id 6ff0eb48e22ca11041b99dddcbdbd287832dc4daee962921e30d310dcecd6429
Jul 06 23:43:23.746148 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.746130    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d80e9c047815a47898056b987d8c55.slice/crio-ae51d0095b7d2bf3bf42b3d61490130474afc08cff042336c9657779804f1d6c WatchSource:0}: Error finding container ae51d0095b7d2bf3bf42b3d61490130474afc08cff042336c9657779804f1d6c: Status 404 returned error can't find the container with id ae51d0095b7d2bf3bf42b3d61490130474afc08cff042336c9657779804f1d6c
Jul 06 23:43:23.751899 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.751883    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:43:23.794898 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.794826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kf45g"
Jul 06 23:43:23.803375 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.803355    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e61d95b_ccd9_42cc_bf00_1a9b486610d0.slice/crio-1b8b83debf0835069fbf57ca3d18152e57d0dbf6ac8ea7823663e7e6bc9f1b37 WatchSource:0}: Error finding container 1b8b83debf0835069fbf57ca3d18152e57d0dbf6ac8ea7823663e7e6bc9f1b37: Status 404 returned error can't find the container with id 1b8b83debf0835069fbf57ca3d18152e57d0dbf6ac8ea7823663e7e6bc9f1b37
Jul 06 23:43:23.811623 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.811604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nl95z"
Jul 06 23:43:23.819387 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.819367    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026dd1c0_6780_4ec9_8386_48ba21752458.slice/crio-54360928dfefb18f45c60566fdccac5164c3e2cdf11c6a4d21b472968841a98e WatchSource:0}: Error finding container 54360928dfefb18f45c60566fdccac5164c3e2cdf11c6a4d21b472968841a98e: Status 404 returned error can't find the container with id 54360928dfefb18f45c60566fdccac5164c3e2cdf11c6a4d21b472968841a98e
Jul 06 23:43:23.825699 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.825681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:23.832890 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.832866    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9729338b_710d_496c_9bd9_e890fa7f1247.slice/crio-04446fe6664610f8698f8f472695b69f79c785e8be4d1cb3d4b967254e83319b WatchSource:0}: Error finding container 04446fe6664610f8698f8f472695b69f79c785e8be4d1cb3d4b967254e83319b: Status 404 returned error can't find the container with id 04446fe6664610f8698f8f472695b69f79c785e8be4d1cb3d4b967254e83319b
Jul 06 23:43:23.841784 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.841767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg"
Jul 06 23:43:23.850532 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.850509    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c9b6e3_74f6_4f86_a6a4_cd69498703fd.slice/crio-6464e79d65e79bdbcdf54d34916aa874b7919e61972375490e592682d5dd83ce WatchSource:0}: Error finding container 6464e79d65e79bdbcdf54d34916aa874b7919e61972375490e592682d5dd83ce: Status 404 returned error can't find the container with id 6464e79d65e79bdbcdf54d34916aa874b7919e61972375490e592682d5dd83ce
Jul 06 23:43:23.864349 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.864323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qgm2"
Jul 06 23:43:23.871157 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.871131    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f81e1e_90e7_4702_845f_d6a1608bc0b5.slice/crio-8e231b3d7bf7e873c9bec8e99216a0da76153ffb951a157495294b7bad68837a WatchSource:0}: Error finding container 8e231b3d7bf7e873c9bec8e99216a0da76153ffb951a157495294b7bad68837a: Status 404 returned error can't find the container with id 8e231b3d7bf7e873c9bec8e99216a0da76153ffb951a157495294b7bad68837a
Jul 06 23:43:23.882519 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.882489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dw97x"
Jul 06 23:43:23.889115 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.889099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc8c8"
Jul 06 23:43:23.889556 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.889531    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77de6403_df73_40b9_932f_c253c2817424.slice/crio-44ead89a48ee3d7cb222f09ff9c9f95d8c2570ee2f36763dbd601c29f11f7a2c WatchSource:0}: Error finding container 44ead89a48ee3d7cb222f09ff9c9f95d8c2570ee2f36763dbd601c29f11f7a2c: Status 404 returned error can't find the container with id 44ead89a48ee3d7cb222f09ff9c9f95d8c2570ee2f36763dbd601c29f11f7a2c
Jul 06 23:43:23.896326 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.896304    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2faa5c3_72a7_4604_a6a4_aec505d0e481.slice/crio-23e819616da81739f42fcfe493ea1e08b9b1ead7b04da5e31eacebbe6decd7d3 WatchSource:0}: Error finding container 23e819616da81739f42fcfe493ea1e08b9b1ead7b04da5e31eacebbe6decd7d3: Status 404 returned error can't find the container with id 23e819616da81739f42fcfe493ea1e08b9b1ead7b04da5e31eacebbe6decd7d3
Jul 06 23:43:23.912491 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.912471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r58hn"
Jul 06 23:43:23.915787 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.915772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:23.921875 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.921850    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ddfd87_2969_4743_995f_1ac87fd3ac53.slice/crio-c82fc3957207f34878663216a2c5163744b7629917f6231b62c7279ab629b20f WatchSource:0}: Error finding container c82fc3957207f34878663216a2c5163744b7629917f6231b62c7279ab629b20f: Status 404 returned error can't find the container with id c82fc3957207f34878663216a2c5163744b7629917f6231b62c7279ab629b20f
Jul 06 23:43:23.924749 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:43:23.924728    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd18c354_7ccf_493c_b2c2_cf4faa238f15.slice/crio-eb9dcc124261ae9fe05dc750d02037e67a70756cab7ec9537de46443b5326606 WatchSource:0}: Error finding container eb9dcc124261ae9fe05dc750d02037e67a70756cab7ec9537de46443b5326606: Status 404 returned error can't find the container with id eb9dcc124261ae9fe05dc750d02037e67a70756cab7ec9537de46443b5326606
Jul 06 23:43:23.926367 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.926350    2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-qmrpq_kube-system(dd18c354-7ccf-493c-b2c2-cf4faa238f15): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 06 23:43:23.926408 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:23.926385    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-qmrpq" podUID="dd18c354-7ccf-493c-b2c2-cf4faa238f15"
Jul 06 23:43:23.966289 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:23.966263    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:24.192485 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.192387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:24.192485 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.192435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:24.192485 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.192464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192573    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192574    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192610    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192625    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192634    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:25.192614876 +0000 UTC m=+3.121590659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192573    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192670    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:25.192656496 +0000 UTC m=+3.121632260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:24.192776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.192728    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:25.192710514 +0000 UTC m=+3.121686296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:24.525388 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.525263    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:38:24 +0000 UTC" deadline="2028-02-20 18:29:08.566332795 +0000 UTC"
Jul 06 23:43:24.525388 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.525337    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14250h45m44.040999546s"
Jul 06 23:43:24.624749 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.624717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:24.624925 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.624851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:24.648803 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.648677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r58hn" event={"ID":"91ddfd87-2969-4743-995f-1ac87fd3ac53","Type":"ContainerStarted","Data":"c82fc3957207f34878663216a2c5163744b7629917f6231b62c7279ab629b20f"}
Jul 06 23:43:24.659333 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.659194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc8c8" event={"ID":"f2faa5c3-72a7-4604-a6a4-aec505d0e481","Type":"ContainerStarted","Data":"23e819616da81739f42fcfe493ea1e08b9b1ead7b04da5e31eacebbe6decd7d3"}
Jul 06 23:43:24.662428 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.662389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dw97x" event={"ID":"77de6403-df73-40b9-932f-c253c2817424","Type":"ContainerStarted","Data":"44ead89a48ee3d7cb222f09ff9c9f95d8c2570ee2f36763dbd601c29f11f7a2c"}
Jul 06 23:43:24.663354 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.663332    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:24.679552 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.679498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qgm2" event={"ID":"74f81e1e-90e7-4702-845f-d6a1608bc0b5","Type":"ContainerStarted","Data":"8e231b3d7bf7e873c9bec8e99216a0da76153ffb951a157495294b7bad68837a"}
Jul 06 23:43:24.719441 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.719399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg" event={"ID":"92c9b6e3-74f6-4f86-a6a4-cd69498703fd","Type":"ContainerStarted","Data":"6464e79d65e79bdbcdf54d34916aa874b7919e61972375490e592682d5dd83ce"}
Jul 06 23:43:24.733217 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.733133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kf45g" event={"ID":"5e61d95b-ccd9-42cc-bf00-1a9b486610d0","Type":"ContainerStarted","Data":"1b8b83debf0835069fbf57ca3d18152e57d0dbf6ac8ea7823663e7e6bc9f1b37"}
Jul 06 23:43:24.735371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.735052    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:43:24.736930 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.736905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal" event={"ID":"ee61f1804b3b1a7302129f8aa73fffa7","Type":"ContainerStarted","Data":"6ff0eb48e22ca11041b99dddcbdbd287832dc4daee962921e30d310dcecd6429"}
Jul 06 23:43:24.766485 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.766005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmrpq" event={"ID":"dd18c354-7ccf-493c-b2c2-cf4faa238f15","Type":"ContainerStarted","Data":"eb9dcc124261ae9fe05dc750d02037e67a70756cab7ec9537de46443b5326606"}
Jul 06 23:43:24.772803 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:24.772770    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-qmrpq" podUID="dd18c354-7ccf-493c-b2c2-cf4faa238f15"
Jul 06 23:43:24.782688 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.782615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"04446fe6664610f8698f8f472695b69f79c785e8be4d1cb3d4b967254e83319b"}
Jul 06 23:43:24.825399 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.825342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerStarted","Data":"54360928dfefb18f45c60566fdccac5164c3e2cdf11c6a4d21b472968841a98e"}
Jul 06 23:43:24.847785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:24.847746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal" event={"ID":"88d80e9c047815a47898056b987d8c55","Type":"ContainerStarted","Data":"ae51d0095b7d2bf3bf42b3d61490130474afc08cff042336c9657779804f1d6c"}
Jul 06 23:43:25.202017 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.201927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:25.202017 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.201997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:25.202279 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.202032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:25.202279 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202161    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:25.202279 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202226    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.202206603 +0000 UTC m=+5.131182371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:25.202679 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202659    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:25.202786 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202688    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:25.202786 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202701    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:25.202786 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202747    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.202731701 +0000 UTC m=+5.131707471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:25.202964 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202807    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:25.202964 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.202842    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.20283022 +0000 UTC m=+5.131805987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:25.526459 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.526318    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:38:24 +0000 UTC" deadline="2028-03-22 05:23:06.912161742 +0000 UTC"
Jul 06 23:43:25.526459 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.526359    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14981h39m41.385807675s"
Jul 06 23:43:25.619643 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.619501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:25.619643 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:25.619648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:25.619918 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.619807    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:25.619983 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:25.619916    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:26.624025 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:26.623480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:26.624025 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:26.623645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:27.222376 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:27.222334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:27.222600 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:27.222405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:27.222600 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:27.222444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:27.222760 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.222740    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:27.222846 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.222831    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.22280789 +0000 UTC m=+9.151783655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:27.223338 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223316    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:27.223440 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223343    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:27.223440 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223357    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:27.223440 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223408    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.223390104 +0000 UTC m=+9.152365887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:27.223727 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223477    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:27.223727 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.223513    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:31.223500606 +0000 UTC m=+9.152476371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:27.619352 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:27.619256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:27.619544 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:27.619265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:27.619544 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.619391    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:27.619544 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:27.619462    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:28.623806 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:28.623773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:28.624303 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:28.623907    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:29.619858 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:29.619790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:29.619858 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:29.619823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:29.620104 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:29.619929    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:29.620331 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:29.620298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:30.619605 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:30.619408    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:30.619605 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:30.619577    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:31.257214 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:31.257167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:31.257410 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:31.257236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:31.257410 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:31.257275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:31.257410 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257362    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:31.257410 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257394    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:31.257410 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257408    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:31.257711 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257414    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:31.257711 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257484    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:39.257453221 +0000 UTC m=+17.186429015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:31.257711 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257497    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:31.257711 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257506    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:39.257495843 +0000 UTC m=+17.186471612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:31.257711 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.257586    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:39.257566178 +0000 UTC m=+17.186541956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:31.619910 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:31.619768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:31.619910 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:31.619815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:31.620388 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.619920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:31.620388 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:31.620030    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:32.621021 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:32.620544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:32.621021 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:32.620651    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:33.619904 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:33.619681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:33.619904 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:33.619731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:33.619904 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:33.619840    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:33.620328 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:33.620288    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:34.618999 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:34.618938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:34.619578 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:34.619093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:35.619211 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:35.619177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:35.619211 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:35.619189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:35.619754 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:35.619344    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:35.619754 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:35.619474    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:36.619754 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:36.619719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:36.620215 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:36.619980    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:37.619471 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:37.619444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:37.619471 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:37.619479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:37.619693 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:37.619580    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:37.619759 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:37.619732    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:38.619588 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:38.619553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:38.620011 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:38.619685    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:39.322941 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:39.322911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:39.322941 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:39.322947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:39.322979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323083    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323084    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323095    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323112    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323084    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:55.323134879 +0000 UTC m=+33.252110644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:39.323175 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323176    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:43:55.323166496 +0000 UTC m=+33.252142263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:39.323601 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.323193    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:55.323184329 +0000 UTC m=+33.252160096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:39.619766 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:39.619686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:39.620176 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.619798    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:39.620176 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:39.619854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:39.620176 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:39.619972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:40.619707 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:40.619673    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:40.620155 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:40.620118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:41.619683 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:41.619647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:41.619683 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:41.619684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:41.619915 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:41.619785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:41.619962 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:41.619926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:42.620565 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:42.620483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:42.621002 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:42.620598    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:43.619027 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:43.618986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:43.619180 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:43.618990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:43.619180 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:43.619097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:43.619180 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:43.619170    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:44.619642 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.619611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:44.620011 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:44.619736    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:44.905018 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.904690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc8c8" event={"ID":"f2faa5c3-72a7-4604-a6a4-aec505d0e481","Type":"ContainerStarted","Data":"61a44458af3f205017cffaae22cab01413a66bd6b123d1b77a5d5aa8568d768d"}
Jul 06 23:43:44.906560 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.906532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qgm2" event={"ID":"74f81e1e-90e7-4702-845f-d6a1608bc0b5","Type":"ContainerStarted","Data":"dafec82435c692dc3164619014ae269348b73ed9c7791739d14b475979b8de63"}
Jul 06 23:43:44.909911 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.909669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"06a025e5a1f796f30eb19ec9c12209c6e35c4518af7d1b9a555928ac937aa30b"}
Jul 06 23:43:44.909911 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.909812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"dd22163cd642e8f8901b09a413a40a9cc98dea81db4adc31c823ad51f2141a43"}
Jul 06 23:43:44.912578 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.912556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal" event={"ID":"88d80e9c047815a47898056b987d8c55","Type":"ContainerStarted","Data":"bcf242adefbf37f1ad27d534ed594f75f11f5ed6993b707cfe28bc01a236d5c0"}
Jul 06 23:43:44.926525 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.926434    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sc8c8" podStartSLOduration=1.950675195 podStartE2EDuration="21.926414735s" totalImagesPullingTime="19.97573954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:44.925778892 +0000 UTC m=+22.854754668" watchObservedRunningTime="2026-07-06 23:43:44.926414735 +0000 UTC m=+22.855390520"
Jul 06 23:43:44.958630 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.958483    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9qgm2" podStartSLOduration=1.9567520269999998 podStartE2EDuration="21.958463139s" totalImagesPullingTime="20.001711112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:44.958206986 +0000 UTC m=+22.887182770" watchObservedRunningTime="2026-07-06 23:43:44.958463139 +0000 UTC m=+22.887438923"
Jul 06 23:43:44.958895 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:44.958864    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-246.ec2.internal" podStartSLOduration=20.958855047 podStartE2EDuration="20.958855047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:44.93989826 +0000 UTC m=+22.868874046" watchObservedRunningTime="2026-07-06 23:43:44.958855047 +0000 UTC m=+22.887830834"
Jul 06 23:43:45.619687 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.619657    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:45.620431 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.619697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:45.620431 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:45.619785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:45.620431 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:45.619888    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:45.916617 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.916587    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee61f1804b3b1a7302129f8aa73fffa7" containerID="f7fcf34e72ae44de2f3a68b9844658ff7af2897cd0e687b49a5a928ccfc6266f" exitCode=0
Jul 06 23:43:45.916792 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.916678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal" event={"ID":"ee61f1804b3b1a7302129f8aa73fffa7","Type":"ContainerDied","Data":"f7fcf34e72ae44de2f3a68b9844658ff7af2897cd0e687b49a5a928ccfc6266f"}
Jul 06 23:43:45.918228 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.918198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmrpq" event={"ID":"dd18c354-7ccf-493c-b2c2-cf4faa238f15","Type":"ContainerStarted","Data":"404afee88238a21e4ae0ebea1977759c9535fd29fd743b9397a8ed366d5004f5"}
Jul 06 23:43:45.921927 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.921902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"3bf2c67a9a57167814c16ec53b9f2c4befbd979743ed77aa1daef069805fc69d"}
Jul 06 23:43:45.922042 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.922000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"3f0207cbd699be16d5ce03dc8cb725003275930eba005a682a4d4a59ec64a09c"}
Jul 06 23:43:45.922109 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.922052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"686a192114143ce9a6e716984094b4f200dc3db82a5baa1917c9604f485b4f5d"}
Jul 06 23:43:45.922109 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.922100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"1d3c4cde8474d7917be719d4be107cc8abef38d6569a8063025918d14580f309"}
Jul 06 23:43:45.923639 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.923613    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="32b999f7efaba82b7a16810a0f3fabebe6285d45a29ed6f76e052cf2787d86ae" exitCode=0
Jul 06 23:43:45.923747 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.923691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"32b999f7efaba82b7a16810a0f3fabebe6285d45a29ed6f76e052cf2787d86ae"}
Jul 06 23:43:45.925272 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.925255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r58hn" event={"ID":"91ddfd87-2969-4743-995f-1ac87fd3ac53","Type":"ContainerStarted","Data":"91eddbbb3ea1531cede00461a506a7d1aabae31abe39ea0dca96518da1625d3e"}
Jul 06 23:43:45.926766 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.926720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dw97x" event={"ID":"77de6403-df73-40b9-932f-c253c2817424","Type":"ContainerStarted","Data":"7926940c6b89703e431e95c0bfb9b174d217cab041dc65113d8f31d8045273e5"}
Jul 06 23:43:45.928357 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.928337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg" event={"ID":"92c9b6e3-74f6-4f86-a6a4-cd69498703fd","Type":"ContainerStarted","Data":"6bd8eefff680a7954fc14f32bf595be73f01850b8ea1430c61e51b3294eda5d7"}
Jul 06 23:43:45.929843 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.929821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kf45g" event={"ID":"5e61d95b-ccd9-42cc-bf00-1a9b486610d0","Type":"ContainerStarted","Data":"2990df1e0d7085c668e0e57dcf63d7dd8e49241db6cf874a40152fc5e4088fea"}
Jul 06 23:43:45.972781 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.972589    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dw97x" podStartSLOduration=3.022221436 podStartE2EDuration="22.972569666s" totalImagesPullingTime="19.95034823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:45.971973517 +0000 UTC m=+23.900949301" watchObservedRunningTime="2026-07-06 23:43:45.972569666 +0000 UTC m=+23.901545453"
Jul 06 23:43:45.987367 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:45.987309    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kf45g" podStartSLOduration=3.109375724 podStartE2EDuration="22.987291035s" totalImagesPullingTime="19.877915311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:45.987231095 +0000 UTC m=+23.916206880" watchObservedRunningTime="2026-07-06 23:43:45.987291035 +0000 UTC m=+23.916266822"
Jul 06 23:43:46.003976 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.003932    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r58hn" podStartSLOduration=3.086037372 podStartE2EDuration="23.003920009s" totalImagesPullingTime="19.917882637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:46.003742196 +0000 UTC m=+23.932717981" watchObservedRunningTime="2026-07-06 23:43:46.003920009 +0000 UTC m=+23.932895793"
Jul 06 23:43:46.019091 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.019059    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qmrpq" podStartSLOduration=1.6850297680000001 podStartE2EDuration="23.019047242s" totalImagesPullingTime="21.334017474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 23:43:46.019036818 +0000 UTC m=+23.948012601" watchObservedRunningTime="2026-07-06 23:43:46.019047242 +0000 UTC m=+23.948023025"
Jul 06 23:43:46.387368 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.387346    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:43:46.558753 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.558619    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:43:46.387362939Z","UUID":"f515293e-f035-457d-adb7-55f0d4dc8531","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:43:46.560037 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.560022    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:43:46.560111 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.560053    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:43:46.619747 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.619714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:46.620208 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:46.619847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:46.933376 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.933344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg" event={"ID":"92c9b6e3-74f6-4f86-a6a4-cd69498703fd","Type":"ContainerStarted","Data":"92082f4918254ba0569d504273a839d9eeec7ae92195c285a22fbc211d013dcd"}
Jul 06 23:43:46.935000 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.934973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal" event={"ID":"ee61f1804b3b1a7302129f8aa73fffa7","Type":"ContainerStarted","Data":"b23b2ef95b9275a26d10f61ac135a237b87ab1fb5be5055acae6d20f999e8332"}
Jul 06 23:43:46.953873 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:46.953812    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-246.ec2.internal" podStartSLOduration=22.953791033999998 podStartE2EDuration="22.953791034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:46.952722463 +0000 UTC m=+24.881698242" watchObservedRunningTime="2026-07-06 23:43:46.953791034 +0000 UTC m=+24.882766819"
Jul 06 23:43:47.619669 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:47.619643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:47.619854 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:47.619676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:47.619854 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:47.619773    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:47.620298 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:47.619912    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:47.941229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:47.941141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"e0426a142a2945206115854d50494253b625df899a6fa2602de7ed0f8ff64b89"}
Jul 06 23:43:47.943587 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:47.943557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg" event={"ID":"92c9b6e3-74f6-4f86-a6a4-cd69498703fd","Type":"ContainerStarted","Data":"512de1d4ffd7e94feab6682f262f37ee5b548d770a93d61e0ef152abfa90d2f4"}
Jul 06 23:43:47.963903 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:47.963858    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gp5rg" podStartSLOduration=2.4501250949999998 podStartE2EDuration="24.96384458s" totalImagesPullingTime="22.513719485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:47.963581687 +0000 UTC m=+25.892557471" watchObservedRunningTime="2026-07-06 23:43:47.96384458 +0000 UTC m=+25.892820363"
Jul 06 23:43:48.522698 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:48.522661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:48.523291 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:48.523272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:48.619026 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:48.618991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:48.619205 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:48.619114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:48.946190 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:48.946168    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:48.946688 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:48.946668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qmrpq"
Jul 06 23:43:49.619178 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.619148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:49.619351 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.619148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:49.619351 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:49.619261    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:49.619351 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:49.619308    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:49.955173 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.954687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" event={"ID":"9729338b-710d-496c-9bd9-e890fa7f1247","Type":"ContainerStarted","Data":"a85963d4b3914822237bc6cba843dc5f75a51905c8ed3e98e886259c5096c68e"}
Jul 06 23:43:49.955173 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.954990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:49.955173 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.955046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:49.975418 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.974863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:49.976349 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.975918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:49.985071 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:49.984943    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv" podStartSLOduration=6.526668698 podStartE2EDuration="26.984925254s" totalImagesPullingTime="20.458256556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:49.982390232 +0000 UTC m=+27.911366010" watchObservedRunningTime="2026-07-06 23:43:49.984925254 +0000 UTC m=+27.913901039"
Jul 06 23:43:50.324243 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:50.324210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:43:50.619819 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:50.619786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:50.619999 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:50.619923    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:51.618865 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:51.618839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:51.619431 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:51.618928    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:51.619431 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:51.618983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:51.619431 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:51.619072    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:52.621183 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:52.621143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:52.621642 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:52.621270    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:52.962908 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:52.962835    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="bbf880f001e2fae29db14b30164ad046da24bcc18796c6886224604c5128cdb8" exitCode=0
Jul 06 23:43:52.962908 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:52.962877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"bbf880f001e2fae29db14b30164ad046da24bcc18796c6886224604c5128cdb8"}
Jul 06 23:43:53.619803 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:53.619769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:53.619941 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:53.619772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:53.619941 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:53.619890    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:53.620035 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:53.619941    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:53.967544 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:53.967450    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="d216d2894b0bf85e63f2a389c82b1ca5f386819e8ea52124b1796809201264c4" exitCode=0
Jul 06 23:43:53.967544 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:53.967524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"d216d2894b0bf85e63f2a389c82b1ca5f386819e8ea52124b1796809201264c4"}
Jul 06 23:43:54.619304 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:54.619282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:54.619432 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:54.619409    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:54.972013 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:54.971920    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="dc8ee0f7a964ee68bf1f1d42c883ab497035821da9545b0bfeff11b4e0f74d1b" exitCode=0
Jul 06 23:43:54.972013 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:54.971987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"dc8ee0f7a964ee68bf1f1d42c883ab497035821da9545b0bfeff11b4e0f74d1b"}
Jul 06 23:43:55.346741 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:55.346711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:55.346890 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:55.346769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:55.346890 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:55.346811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:55.346890 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346863    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:55.346976 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346918    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret podName:13026d5d-808c-48f5-bc32-791a316445d5 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:27.346903106 +0000 UTC m=+65.275878872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret") pod "global-pull-secret-syncer-b8l9p" (UID: "13026d5d-808c-48f5-bc32-791a316445d5") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:43:55.346976 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346954    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:43:55.347088 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346981    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:43:55.347088 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346983    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:55.347088 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.346994    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7jllc for pod openshift-network-diagnostics/network-check-target-rtlbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:55.347088 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.347040    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc podName:ddb2e040-9eb0-4271-85fb-7dbd15aceedf nodeName:}" failed. No retries permitted until 2026-07-06 23:44:27.347024764 +0000 UTC m=+65.276000527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jllc" (UniqueName: "kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc") pod "network-check-target-rtlbp" (UID: "ddb2e040-9eb0-4271-85fb-7dbd15aceedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:43:55.347088 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.347056    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs podName:faefef84-7e31-4ba4-9477-713951e7d3f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:27.347049375 +0000 UTC m=+65.276025136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs") pod "network-metrics-daemon-976vc" (UID: "faefef84-7e31-4ba4-9477-713951e7d3f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:43:55.619655 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:55.619578    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:55.619795 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:55.619577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:55.619795 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.619731    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:55.619896 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:55.619852    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:56.619355 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:56.619178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:56.619776 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:56.619422    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:57.619130 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:57.619101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:57.619293 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:57.619101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:57.619293 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:57.619235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:57.619406 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:57.619317    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:58.619063 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:58.619030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:43:58.619331 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:58.619163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:43:59.619685 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:59.619655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:43:59.619685 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:59.619692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:43:59.620064 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:59.619781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:43:59.620064 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:43:59.619902    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:43:59.987410 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:43:59.987380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerStarted","Data":"5e131f13760b53aa5e06482baabbfaa4ec3261d58e4916562aa759e5cd063a80"}
Jul 06 23:44:00.619983 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:00.619948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:00.620447 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:00.620048    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:44:00.992620 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:00.992539    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="5e131f13760b53aa5e06482baabbfaa4ec3261d58e4916562aa759e5cd063a80" exitCode=0
Jul 06 23:44:00.992620 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:00.992577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"5e131f13760b53aa5e06482baabbfaa4ec3261d58e4916562aa759e5cd063a80"}
Jul 06 23:44:01.619666 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:01.619635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:01.619833 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:01.619742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:44:01.619833 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:01.619795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:01.619905 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:01.619885    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:44:01.997821 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:01.997731    2580 generic.go:356] "Generic (PLEG): container finished" podID="026dd1c0-6780-4ec9-8386-48ba21752458" containerID="b264b65ac91e8ebcb0658222a514f0d4e71226d80ed6d66af65ab2d828ce3cc7" exitCode=0
Jul 06 23:44:01.997821 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:01.997789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerDied","Data":"b264b65ac91e8ebcb0658222a514f0d4e71226d80ed6d66af65ab2d828ce3cc7"}
Jul 06 23:44:02.619826 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.619798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:02.620007 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:02.619902    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:44:02.900429 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.900348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8l9p"]
Jul 06 23:44:02.900610 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.900466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:02.900610 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:02.900595    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:44:02.907454 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.907415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-976vc"]
Jul 06 23:44:02.907618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.907552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:02.907684 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:02.907643    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:44:02.908213 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:02.908179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtlbp"]
Jul 06 23:44:03.003057 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:03.003022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nl95z" event={"ID":"026dd1c0-6780-4ec9-8386-48ba21752458","Type":"ContainerStarted","Data":"c8a49474f11af7fff1a95a8f165661c87008e1174004418bbd855fecd41c3499"}
Jul 06 23:44:03.003554 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:03.003234    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:03.003554 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:03.003331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:44:03.030734 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:03.030689    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nl95z" podStartSLOduration=7.787344579 podStartE2EDuration="40.030673269s" totalImagesPullingTime="32.24332869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:03.030154195 +0000 UTC m=+40.959129979" watchObservedRunningTime="2026-07-06 23:44:03.030673269 +0000 UTC m=+40.959649054"
Jul 06 23:44:04.619457 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:04.619426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:04.619929 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:04.619431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:04.619929 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:04.619561    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:44:04.619929 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:04.619431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:04.619929 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:04.619606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:44:04.619929 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:04.619657    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:44:06.619956 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.619717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:06.620329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.619716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:06.620329 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:06.620066    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8l9p" podUID="13026d5d-808c-48f5-bc32-791a316445d5"
Jul 06 23:44:06.620329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.619721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:06.620329 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:06.620115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-976vc" podUID="faefef84-7e31-4ba4-9477-713951e7d3f1"
Jul 06 23:44:06.620329 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:06.620165    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtlbp" podUID="ddb2e040-9eb0-4271-85fb-7dbd15aceedf"
Jul 06 23:44:06.828683 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.828657    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-246.ec2.internal" event="NodeReady"
Jul 06 23:44:06.828839 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.828808    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:44:06.866817 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.866789    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d948d5fb4-25fk2"]
Jul 06 23:44:06.892154 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.892088    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ft72p"]
Jul 06 23:44:06.892277 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.892216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:06.894960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.894939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lx775\""
Jul 06 23:44:06.894960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.894948    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:44:06.896233 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.896218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:44:06.896737 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.896721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:44:06.901949 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.901928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:44:06.908196 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.908175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d948d5fb4-25fk2"]
Jul 06 23:44:06.908289 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.908213    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hk8rf"]
Jul 06 23:44:06.908289 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.908281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:06.912714 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.912696    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:44:06.912823 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.912714    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:44:06.913335 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.913294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h6mrd\""
Jul 06 23:44:06.930206 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.930187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hk8rf"]
Jul 06 23:44:06.930287 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.930212    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ft72p"]
Jul 06 23:44:06.930329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.930294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:06.932977 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.932961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:44:06.933079 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.932987    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:44:06.933141 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.933081    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7np4z\""
Jul 06 23:44:06.933182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.933143    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:44:06.984463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:06.984441    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bm5g9"]
Jul 06 23:44:07.006339 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.006319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bm5g9"]
Jul 06 23:44:07.006432 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.006417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.009071 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.009054    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:44:07.009231 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.009211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qjnpx\""
Jul 06 23:44:07.009304 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.009234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:44:07.009392 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.009314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:44:07.009392 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.009363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:44:07.034947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.034919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-installation-pull-secrets\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.034947 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.034949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67be5cc5-4b74-48f8-bc91-a34628451205-tmp-dir\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.035105 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.034970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7x9\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-kube-api-access-7l7x9\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035105 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.034988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-cert\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.035105 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67be5cc5-4b74-48f8-bc91-a34628451205-metrics-tls\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.035105 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-registry-tls\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035105 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-trusted-ca\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpdg\" (UniqueName: \"kubernetes.io/projected/67be5cc5-4b74-48f8-bc91-a34628451205-kube-api-access-xhpdg\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.035246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/098f5c0d-f7da-475b-9814-950a75b94e87-ca-trust-extracted\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426tj\" (UniqueName: \"kubernetes.io/projected/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-kube-api-access-426tj\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.035246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-image-registry-private-configuration\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035361 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-registry-certificates\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035361 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-bound-sa-token\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.035361 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.035288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67be5cc5-4b74-48f8-bc91-a34628451205-config-volume\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136124 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67be5cc5-4b74-48f8-bc91-a34628451205-config-volume\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136124 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-data-volume\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.136299 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czrbn\" (UniqueName: \"kubernetes.io/projected/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-api-access-czrbn\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.136299 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-crio-socket\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.136299 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-installation-pull-secrets\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67be5cc5-4b74-48f8-bc91-a34628451205-tmp-dir\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7x9\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-kube-api-access-7l7x9\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-cert\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.136386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.136581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67be5cc5-4b74-48f8-bc91-a34628451205-metrics-tls\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-registry-tls\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-trusted-ca\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpdg\" (UniqueName: \"kubernetes.io/projected/67be5cc5-4b74-48f8-bc91-a34628451205-kube-api-access-xhpdg\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/098f5c0d-f7da-475b-9814-950a75b94e87-ca-trust-extracted\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-426tj\" (UniqueName: \"kubernetes.io/projected/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-kube-api-access-426tj\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136689    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67be5cc5-4b74-48f8-bc91-a34628451205-tmp-dir\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-image-registry-private-configuration\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-registry-certificates\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.136761 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.136744    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67be5cc5-4b74-48f8-bc91-a34628451205-config-volume\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.137246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.137185    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/098f5c0d-f7da-475b-9814-950a75b94e87-ca-trust-extracted\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.137472 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.137422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-bound-sa-token\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.137577 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.137511    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-registry-certificates\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.138045 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.138022    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/098f5c0d-f7da-475b-9814-950a75b94e87-trusted-ca\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.140810 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.140789    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-image-registry-private-configuration\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.140891 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.140791    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/098f5c0d-f7da-475b-9814-950a75b94e87-installation-pull-secrets\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.140891 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.140815    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67be5cc5-4b74-48f8-bc91-a34628451205-metrics-tls\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.140891 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.140878    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-cert\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.140995 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.140901    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-registry-tls\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.153571 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.153520    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpdg\" (UniqueName: \"kubernetes.io/projected/67be5cc5-4b74-48f8-bc91-a34628451205-kube-api-access-xhpdg\") pod \"dns-default-ft72p\" (UID: \"67be5cc5-4b74-48f8-bc91-a34628451205\") " pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.156435 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.156415    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-bound-sa-token\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.180768 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.180733    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-426tj\" (UniqueName: \"kubernetes.io/projected/368ec2cb-fdd2-46f5-b2bc-b0babd306a00-kube-api-access-426tj\") pod \"ingress-canary-hk8rf\" (UID: \"368ec2cb-fdd2-46f5-b2bc-b0babd306a00\") " pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.182605 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.182580    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7x9\" (UniqueName: \"kubernetes.io/projected/098f5c0d-f7da-475b-9814-950a75b94e87-kube-api-access-7l7x9\") pod \"image-registry-5d948d5fb4-25fk2\" (UID: \"098f5c0d-f7da-475b-9814-950a75b94e87\") " pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.203410 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.203384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:07.216557 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.216531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:07.238417 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hk8rf"
Jul 06 23:44:07.238551 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.238614 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.238667 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-data-volume\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.238667 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czrbn\" (UniqueName: \"kubernetes.io/projected/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-api-access-czrbn\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.238667 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-crio-socket\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.238918 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238898    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-crio-socket\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.239005 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.238968    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-data-volume\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.239207 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.239176    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.240876 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.240856    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.246897 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.246877    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czrbn\" (UniqueName: \"kubernetes.io/projected/5d4b0d7c-b84a-4278-b083-aa5d85912c1c-kube-api-access-czrbn\") pod \"insights-runtime-extractor-bm5g9\" (UID: \"5d4b0d7c-b84a-4278-b083-aa5d85912c1c\") " pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.314730 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.314704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bm5g9"
Jul 06 23:44:07.424136 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.420461    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d948d5fb4-25fk2"]
Jul 06 23:44:07.424136 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.423321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ft72p"]
Jul 06 23:44:07.428385 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:07.428225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098f5c0d_f7da_475b_9814_950a75b94e87.slice/crio-d99d98ba6aeaf53a216455b43b91cde8b894ca444ddc538333544329237b3ee6 WatchSource:0}: Error finding container d99d98ba6aeaf53a216455b43b91cde8b894ca444ddc538333544329237b3ee6: Status 404 returned error can't find the container with id d99d98ba6aeaf53a216455b43b91cde8b894ca444ddc538333544329237b3ee6
Jul 06 23:44:07.431344 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:07.431324    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67be5cc5_4b74_48f8_bc91_a34628451205.slice/crio-2ece6b900eaa6f509e314c82611cb10187af4103afdab052271184c5f5c7ad21 WatchSource:0}: Error finding container 2ece6b900eaa6f509e314c82611cb10187af4103afdab052271184c5f5c7ad21: Status 404 returned error can't find the container with id 2ece6b900eaa6f509e314c82611cb10187af4103afdab052271184c5f5c7ad21
Jul 06 23:44:07.444736 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.444713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hk8rf"]
Jul 06 23:44:07.448097 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:07.448077    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368ec2cb_fdd2_46f5_b2bc_b0babd306a00.slice/crio-c1ef6c4f86c2df0f611b022b0e4e08c40b70f34d0280301a97cb1d6e908389c5 WatchSource:0}: Error finding container c1ef6c4f86c2df0f611b022b0e4e08c40b70f34d0280301a97cb1d6e908389c5: Status 404 returned error can't find the container with id c1ef6c4f86c2df0f611b022b0e4e08c40b70f34d0280301a97cb1d6e908389c5
Jul 06 23:44:07.505219 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:07.505050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bm5g9"]
Jul 06 23:44:07.508486 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:07.508466    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4b0d7c_b84a_4278_b083_aa5d85912c1c.slice/crio-4f9923fa4350fc474ecd443c33aaad272dcefbee85190f45265c51fee6f5c54c WatchSource:0}: Error finding container 4f9923fa4350fc474ecd443c33aaad272dcefbee85190f45265c51fee6f5c54c: Status 404 returned error can't find the container with id 4f9923fa4350fc474ecd443c33aaad272dcefbee85190f45265c51fee6f5c54c
Jul 06 23:44:08.016229 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.016186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bm5g9" event={"ID":"5d4b0d7c-b84a-4278-b083-aa5d85912c1c","Type":"ContainerStarted","Data":"4f9923fa4350fc474ecd443c33aaad272dcefbee85190f45265c51fee6f5c54c"}
Jul 06 23:44:08.017514 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.017446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ft72p" event={"ID":"67be5cc5-4b74-48f8-bc91-a34628451205","Type":"ContainerStarted","Data":"2ece6b900eaa6f509e314c82611cb10187af4103afdab052271184c5f5c7ad21"}
Jul 06 23:44:08.018689 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.018656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hk8rf" event={"ID":"368ec2cb-fdd2-46f5-b2bc-b0babd306a00","Type":"ContainerStarted","Data":"c1ef6c4f86c2df0f611b022b0e4e08c40b70f34d0280301a97cb1d6e908389c5"}
Jul 06 23:44:08.020367 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.020343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2" event={"ID":"098f5c0d-f7da-475b-9814-950a75b94e87","Type":"ContainerStarted","Data":"b92cd733a09622e76e054ef454d50f12fed34d4fa4c8457eda5ca6bfbd4cc684"}
Jul 06 23:44:08.020448 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.020387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2" event={"ID":"098f5c0d-f7da-475b-9814-950a75b94e87","Type":"ContainerStarted","Data":"d99d98ba6aeaf53a216455b43b91cde8b894ca444ddc538333544329237b3ee6"}
Jul 06 23:44:08.020572 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.020553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:08.040022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.039977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2" podStartSLOduration=7.039962408 podStartE2EDuration="7.039962408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:08.038675761 +0000 UTC m=+45.967651546" watchObservedRunningTime="2026-07-06 23:44:08.039962408 +0000 UTC m=+45.968938191"
Jul 06 23:44:08.619672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.619642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:08.620435 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.620414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:08.621479 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.621460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:08.624230 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.624210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xv6vb\""
Jul 06 23:44:08.626002 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.625971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:44:08.626236 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.626220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:44:08.626372 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.626316    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:44:08.626372 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.626327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m52g\""
Jul 06 23:44:08.626485 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:08.626451    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:44:14.038642 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.038612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ft72p" event={"ID":"67be5cc5-4b74-48f8-bc91-a34628451205","Type":"ContainerStarted","Data":"c8d1e3565e67169139a95c90fc5696eb0d88e0f6c45c11e96fb497338f393ba4"}
Jul 06 23:44:14.039181 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.038671    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ft72p" event={"ID":"67be5cc5-4b74-48f8-bc91-a34628451205","Type":"ContainerStarted","Data":"db84cc0ec4762e1e96e3e5515342ce0b76d8079fa1a8064a87e85bd1d05cd43d"}
Jul 06 23:44:14.039181 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.038706    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:14.040122 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.040097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hk8rf" event={"ID":"368ec2cb-fdd2-46f5-b2bc-b0babd306a00","Type":"ContainerStarted","Data":"e805d0fa3156f4c3fb67aa8590f2e02dc3fea30fa50e7133a8b31eaeea266e6d"}
Jul 06 23:44:14.041372 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.041351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bm5g9" event={"ID":"5d4b0d7c-b84a-4278-b083-aa5d85912c1c","Type":"ContainerStarted","Data":"c5f2ed5a9ef3edcaaca8d5de23ad8758c0f1347d167f5cffd0d937216ca01ae0"}
Jul 06 23:44:14.057346 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.057267    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ft72p" podStartSLOduration=1.95223318 podStartE2EDuration="8.057254981s" totalImagesPullingTime="6.105021801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:14.05704154 +0000 UTC m=+51.986017326" watchObservedRunningTime="2026-07-06 23:44:14.057254981 +0000 UTC m=+51.986230824"
Jul 06 23:44:14.076884 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:14.076842    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hk8rf" podStartSLOduration=1.988921734 podStartE2EDuration="8.076828044s" totalImagesPullingTime="6.08790631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:14.076102774 +0000 UTC m=+52.005078558" watchObservedRunningTime="2026-07-06 23:44:14.076828044 +0000 UTC m=+52.005803828"
Jul 06 23:44:16.049697 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:16.049660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bm5g9" event={"ID":"5d4b0d7c-b84a-4278-b083-aa5d85912c1c","Type":"ContainerStarted","Data":"d6224fc3f7d2d551c1f72ad0fd0298fcfb12025b230eefcc088bcb387e67c2ed"}
Jul 06 23:44:18.060575 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:18.060536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bm5g9" event={"ID":"5d4b0d7c-b84a-4278-b083-aa5d85912c1c","Type":"ContainerStarted","Data":"7c383c0ddc68b86978ad6684d06278560f2f34d81b590c1e2e75b5aa52145835"}
Jul 06 23:44:18.079698 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:18.079652    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bm5g9" podStartSLOduration=2.3307486600000002 podStartE2EDuration="12.079636621s" totalImagesPullingTime="9.748887961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:44:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:18.077798148 +0000 UTC m=+56.006773942" watchObservedRunningTime="2026-07-06 23:44:18.079636621 +0000 UTC m=+56.008612405"
Jul 06 23:44:19.242148 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.242115    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"]
Jul 06 23:44:19.244245 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.244230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.248370 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.248351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:44:19.248486 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.248351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 23:44:19.248774 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.248756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mcvlh\""
Jul 06 23:44:19.248830 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.248756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 23:44:19.249016 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.249004    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:44:19.249060 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.249015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:44:19.259133 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.259112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"]
Jul 06 23:44:19.328446 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.328416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4j4q\" (UniqueName: \"kubernetes.io/projected/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-kube-api-access-l4j4q\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.328605 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.328472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.328605 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.328547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.328605 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.328567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.429434 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.429404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.429553 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.429467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.429553 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.429516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.429620 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.429564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4j4q\" (UniqueName: \"kubernetes.io/projected/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-kube-api-access-l4j4q\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.429668 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:19.429647    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 23:44:19.429725 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:19.429715    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls podName:e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e nodeName:}" failed. No retries permitted until 2026-07-06 23:44:19.929698467 +0000 UTC m=+57.858674248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-j8kg4" (UID: "e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e") : secret "prometheus-operator-tls" not found
Jul 06 23:44:19.430240 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.430213    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.433398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.433381    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.439188 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.439163    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4j4q\" (UniqueName: \"kubernetes.io/projected/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-kube-api-access-l4j4q\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.933762 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.933708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:19.935990 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:19.935961    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-j8kg4\" (UID: \"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:20.153576 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:20.153543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"
Jul 06 23:44:20.271321 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:20.271301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4"]
Jul 06 23:44:20.273454 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:20.273425    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7eb8ab0_148b_4c6b_b23b_ba15ebddc87e.slice/crio-1841819e29013515082e4b8ac9f12bf216abf76b07596161a767677759ecdf51 WatchSource:0}: Error finding container 1841819e29013515082e4b8ac9f12bf216abf76b07596161a767677759ecdf51: Status 404 returned error can't find the container with id 1841819e29013515082e4b8ac9f12bf216abf76b07596161a767677759ecdf51
Jul 06 23:44:21.070290 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:21.070252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4" event={"ID":"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e","Type":"ContainerStarted","Data":"1841819e29013515082e4b8ac9f12bf216abf76b07596161a767677759ecdf51"}
Jul 06 23:44:21.969717 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:21.969692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtrpv"
Jul 06 23:44:22.074325 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:22.074295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4" event={"ID":"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e","Type":"ContainerStarted","Data":"ce05db0b0fd19072f59481408cc03b6b842422a926f955081ab20a5cf0e5a9f2"}
Jul 06 23:44:22.074541 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:22.074343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4" event={"ID":"e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e","Type":"ContainerStarted","Data":"435e662e0977ecf324d707565a69882864e29e7d56bfeabbc465498f7d905a7c"}
Jul 06 23:44:22.099030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:22.098974    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-j8kg4" podStartSLOduration=2.062861461 podStartE2EDuration="3.098958948s" totalImagesPullingTime="1.036097487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:22.098167292 +0000 UTC m=+60.027143093" watchObservedRunningTime="2026-07-06 23:44:22.098958948 +0000 UTC m=+60.027935114"
Jul 06 23:44:23.664691 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.664657    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5lg58"]
Jul 06 23:44:23.691868 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.691842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.694822 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.694793    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:44:23.694960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.694823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-57rgw\""
Jul 06 23:44:23.694960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.694826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:44:23.695057 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.694960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:44:23.761920 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.761887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m7ch\" (UniqueName: \"kubernetes.io/projected/54ca7d56-7210-41b9-9aea-9cd845b8c233-kube-api-access-2m7ch\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.761920 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.761922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-wtmp\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762101 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.761946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-tls\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762101 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.761993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-sys\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762101 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.762027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-accelerators-collector-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762101 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.762089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-root\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762225 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.762118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-metrics-client-ca\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762225 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.762140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.762225 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.762162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-textfile\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863320 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m7ch\" (UniqueName: \"kubernetes.io/projected/54ca7d56-7210-41b9-9aea-9cd845b8c233-kube-api-access-2m7ch\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863320 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-wtmp\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-tls\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-sys\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-accelerators-collector-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-wtmp\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-root\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-metrics-client-ca\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863556 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863536    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-sys\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863884 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863567    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54ca7d56-7210-41b9-9aea-9cd845b8c233-root\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863884 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.863884 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-textfile\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.864027 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.863908    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-textfile\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.864182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.864153    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-metrics-client-ca\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.864316 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.864299    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-accelerators-collector-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.865769 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.865747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-tls\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.865854 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.865834    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54ca7d56-7210-41b9-9aea-9cd845b8c233-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:23.871720 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:23.871702    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m7ch\" (UniqueName: \"kubernetes.io/projected/54ca7d56-7210-41b9-9aea-9cd845b8c233-kube-api-access-2m7ch\") pod \"node-exporter-5lg58\" (UID: \"54ca7d56-7210-41b9-9aea-9cd845b8c233\") " pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:24.000803 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.000743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5lg58"
Jul 06 23:44:24.036164 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:24.036132    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ca7d56_7210_41b9_9aea_9cd845b8c233.slice/crio-5c28d6d879ed3c448d24b9e40a73b358cff3b7f44aa4236acea0c29ce7daf152 WatchSource:0}: Error finding container 5c28d6d879ed3c448d24b9e40a73b358cff3b7f44aa4236acea0c29ce7daf152: Status 404 returned error can't find the container with id 5c28d6d879ed3c448d24b9e40a73b358cff3b7f44aa4236acea0c29ce7daf152
Jul 06 23:44:24.046021 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.046000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ft72p"
Jul 06 23:44:24.081637 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.081611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5lg58" event={"ID":"54ca7d56-7210-41b9-9aea-9cd845b8c233","Type":"ContainerStarted","Data":"5c28d6d879ed3c448d24b9e40a73b358cff3b7f44aa4236acea0c29ce7daf152"}
Jul 06 23:44:24.665270 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.665180    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:44:24.670336 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.670305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673625    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673728    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hdwxx\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673809    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673729    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 23:44:24.673986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.673708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 23:44:24.674475 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.674340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 23:44:24.674567 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.674536    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 23:44:24.683700 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.683680    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:44:24.770822 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.770747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771006 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.770831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771006 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.770911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771115 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771115 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771115 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771269 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771269 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771269 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-web-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771269 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771440 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-config-out\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771440 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.771440 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.771355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769hn\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-kube-api-access-769hn\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872665 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872665 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-web-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-config-out\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769hn\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-kube-api-access-769hn\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.872923 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.873300 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.873300 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.873300 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.872991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.873300 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:44:24.873038    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle podName:726d0e21-30b5-4c61-8233-dd1179b53be6 nodeName:}" failed. No retries permitted until 2026-07-06 23:44:25.373012452 +0000 UTC m=+63.301988231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "726d0e21-30b5-4c61-8233-dd1179b53be6") : configmap references non-existent config key: ca-bundle.crt
Jul 06 23:44:24.873300 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.873084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.873976 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.873948    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.875785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.875740    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.876618 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.876595    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-web-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.876814 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.876775    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877063 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877041    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877369 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877346    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877455 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877382    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877585 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877535    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877749 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877731    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.877749 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.877747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/726d0e21-30b5-4c61-8233-dd1179b53be6-config-out\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.879160 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.879141    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/726d0e21-30b5-4c61-8233-dd1179b53be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:24.885430 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:24.885410    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769hn\" (UniqueName: \"kubernetes.io/projected/726d0e21-30b5-4c61-8233-dd1179b53be6-kube-api-access-769hn\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:25.086106 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.086076    2580 generic.go:356] "Generic (PLEG): container finished" podID="54ca7d56-7210-41b9-9aea-9cd845b8c233" containerID="7a896540bb8ba5eb5c56211f81506147bba7a9e87501be14bf7ce6bbf263b978" exitCode=0
Jul 06 23:44:25.086254 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.086145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5lg58" event={"ID":"54ca7d56-7210-41b9-9aea-9cd845b8c233","Type":"ContainerDied","Data":"7a896540bb8ba5eb5c56211f81506147bba7a9e87501be14bf7ce6bbf263b978"}
Jul 06 23:44:25.377061 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.377010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:25.377804 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.377784    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726d0e21-30b5-4c61-8233-dd1179b53be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"726d0e21-30b5-4c61-8233-dd1179b53be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:25.582969 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.582938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:44:25.716077 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:25.716046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:44:25.719544 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:25.719518    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726d0e21_30b5_4c61_8233_dd1179b53be6.slice/crio-a2b03981334c878ad2d99a03d98144621a2b3ed795271d31b4b9341c22dc8b38 WatchSource:0}: Error finding container a2b03981334c878ad2d99a03d98144621a2b3ed795271d31b4b9341c22dc8b38: Status 404 returned error can't find the container with id a2b03981334c878ad2d99a03d98144621a2b3ed795271d31b4b9341c22dc8b38
Jul 06 23:44:26.091827 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:26.091786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5lg58" event={"ID":"54ca7d56-7210-41b9-9aea-9cd845b8c233","Type":"ContainerStarted","Data":"2efe10a87f45549cd264d95de18a329834c2dff4ff842a77d0b6469c1d82fc9b"}
Jul 06 23:44:26.091996 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:26.091853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5lg58" event={"ID":"54ca7d56-7210-41b9-9aea-9cd845b8c233","Type":"ContainerStarted","Data":"c830475030a5bb29faf1b813e263680dcdf8740e32a5478c4e813708b15b850d"}
Jul 06 23:44:26.093045 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:26.093019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"a2b03981334c878ad2d99a03d98144621a2b3ed795271d31b4b9341c22dc8b38"}
Jul 06 23:44:26.109833 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:26.109788    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5lg58" podStartSLOduration=2.155400958 podStartE2EDuration="3.109772145s" totalImagesPullingTime="890.285084ms" totalInitContainerRuntime="64.086103ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:26.10879568 +0000 UTC m=+64.037771464" watchObservedRunningTime="2026-07-06 23:44:26.109772145 +0000 UTC m=+64.038747960"
Jul 06 23:44:27.097706 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.097670    2580 generic.go:356] "Generic (PLEG): container finished" podID="726d0e21-30b5-4c61-8233-dd1179b53be6" containerID="a0b6b026d291dc3c3c714402c5160b2a574fc3206767d1ba2d11ad31243aa5ed" exitCode=0
Jul 06 23:44:27.098087 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.097748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerDied","Data":"a0b6b026d291dc3c3c714402c5160b2a574fc3206767d1ba2d11ad31243aa5ed"}
Jul 06 23:44:27.396186 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.396103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:27.396186 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.396153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:27.396371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.396257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:27.399963 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.399946    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:44:27.400027 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.399968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:44:27.400027 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.400002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:44:27.409244 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.409223    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13026d5d-808c-48f5-bc32-791a316445d5-original-pull-secret\") pod \"global-pull-secret-syncer-b8l9p\" (UID: \"13026d5d-808c-48f5-bc32-791a316445d5\") " pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:27.409340 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.409297    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faefef84-7e31-4ba4-9477-713951e7d3f1-metrics-certs\") pod \"network-metrics-daemon-976vc\" (UID: \"faefef84-7e31-4ba4-9477-713951e7d3f1\") " pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:27.409573 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.409554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:44:27.419844 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.419822    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jllc\" (UniqueName: \"kubernetes.io/projected/ddb2e040-9eb0-4271-85fb-7dbd15aceedf-kube-api-access-7jllc\") pod \"network-check-target-rtlbp\" (UID: \"ddb2e040-9eb0-4271-85fb-7dbd15aceedf\") " pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:27.539387 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.539364    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xv6vb\""
Jul 06 23:44:27.547704 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.547686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-976vc"
Jul 06 23:44:27.548967 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.548949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m52g\""
Jul 06 23:44:27.553182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.553162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8l9p"
Jul 06 23:44:27.557335 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.557313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:27.703924 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.703811    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-976vc"]
Jul 06 23:44:27.707234 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:27.707202    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaefef84_7e31_4ba4_9477_713951e7d3f1.slice/crio-d01cea2f2c8699960995aa64a2bad47660456975d3c3e4e1bc4a94a432920fac WatchSource:0}: Error finding container d01cea2f2c8699960995aa64a2bad47660456975d3c3e4e1bc4a94a432920fac: Status 404 returned error can't find the container with id d01cea2f2c8699960995aa64a2bad47660456975d3c3e4e1bc4a94a432920fac
Jul 06 23:44:27.727020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.726994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8l9p"]
Jul 06 23:44:27.730529 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:27.730480    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13026d5d_808c_48f5_bc32_791a316445d5.slice/crio-b358ef550644cb6f0c4e1e39687f71f438fdd3a088a91c3d4eb6754c17cfd0c9 WatchSource:0}: Error finding container b358ef550644cb6f0c4e1e39687f71f438fdd3a088a91c3d4eb6754c17cfd0c9: Status 404 returned error can't find the container with id b358ef550644cb6f0c4e1e39687f71f438fdd3a088a91c3d4eb6754c17cfd0c9
Jul 06 23:44:27.934065 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:27.933991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtlbp"]
Jul 06 23:44:27.936932 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:27.936906    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb2e040_9eb0_4271_85fb_7dbd15aceedf.slice/crio-d28900e2d9eba7b6ae0b90e22f3830375148483ebc4eedadb11f79ccee5c0c03 WatchSource:0}: Error finding container d28900e2d9eba7b6ae0b90e22f3830375148483ebc4eedadb11f79ccee5c0c03: Status 404 returned error can't find the container with id d28900e2d9eba7b6ae0b90e22f3830375148483ebc4eedadb11f79ccee5c0c03
Jul 06 23:44:28.101542 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.101487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8l9p" event={"ID":"13026d5d-808c-48f5-bc32-791a316445d5","Type":"ContainerStarted","Data":"b358ef550644cb6f0c4e1e39687f71f438fdd3a088a91c3d4eb6754c17cfd0c9"}
Jul 06 23:44:28.102665 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.102642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-976vc" event={"ID":"faefef84-7e31-4ba4-9477-713951e7d3f1","Type":"ContainerStarted","Data":"d01cea2f2c8699960995aa64a2bad47660456975d3c3e4e1bc4a94a432920fac"}
Jul 06 23:44:28.103672 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.103653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtlbp" event={"ID":"ddb2e040-9eb0-4271-85fb-7dbd15aceedf","Type":"ContainerStarted","Data":"d28900e2d9eba7b6ae0b90e22f3830375148483ebc4eedadb11f79ccee5c0c03"}
Jul 06 23:44:28.414592 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.414562    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"]
Jul 06 23:44:28.417025 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.417006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.421047 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.420647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zwvcz\""
Jul 06 23:44:28.421047 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.420899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 23:44:28.429951 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.429899    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"]
Jul 06 23:44:28.504291 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.504122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b67016e8-faf7-4573-8bee-86986c58c30d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.504291 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.504192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2r2n\" (UniqueName: \"kubernetes.io/projected/b67016e8-faf7-4573-8bee-86986c58c30d-kube-api-access-f2r2n\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.604836 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.604785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b67016e8-faf7-4573-8bee-86986c58c30d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.605002 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.604842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2r2n\" (UniqueName: \"kubernetes.io/projected/b67016e8-faf7-4573-8bee-86986c58c30d-kube-api-access-f2r2n\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.608027 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.608002    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b67016e8-faf7-4573-8bee-86986c58c30d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.614664 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.614604    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2r2n\" (UniqueName: \"kubernetes.io/projected/b67016e8-faf7-4573-8bee-86986c58c30d-kube-api-access-f2r2n\") pod \"monitoring-plugin-d5dcff7cf-gwxsf\" (UID: \"b67016e8-faf7-4573-8bee-86986c58c30d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:28.737869 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:28.737778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:29.030353 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.030327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d948d5fb4-25fk2"
Jul 06 23:44:29.043418 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.043348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"]
Jul 06 23:44:29.046650 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:29.046615    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67016e8_faf7_4573_8bee_86986c58c30d.slice/crio-ff4a37c44983e06a0d6e0aff8483bcfa59050a8a4595612c591a1b2c63bace93 WatchSource:0}: Error finding container ff4a37c44983e06a0d6e0aff8483bcfa59050a8a4595612c591a1b2c63bace93: Status 404 returned error can't find the container with id ff4a37c44983e06a0d6e0aff8483bcfa59050a8a4595612c591a1b2c63bace93
Jul 06 23:44:29.117794 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.117703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"01df93552169e5d752abe485c465875f88499c89b8268bb25e70e4d56d8f0956"}
Jul 06 23:44:29.121206 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.121176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-976vc" event={"ID":"faefef84-7e31-4ba4-9477-713951e7d3f1","Type":"ContainerStarted","Data":"b834ef7833ec214f622f43df415bf7a7daebede6bf60070e3ce5995a176b05ed"}
Jul 06 23:44:29.127159 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.127101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf" event={"ID":"b67016e8-faf7-4573-8bee-86986c58c30d","Type":"ContainerStarted","Data":"ff4a37c44983e06a0d6e0aff8483bcfa59050a8a4595612c591a1b2c63bace93"}
Jul 06 23:44:29.837004 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.836970    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:44:29.850228 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.849659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.853580 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.853557    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.855229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.855362    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.855690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.855899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-asig60hkoqou\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.856200    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.856442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 23:44:29.856673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.856458    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 23:44:29.857661 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.857101    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 23:44:29.858080 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858062    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 23:44:29.858775 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858318    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 23:44:29.858775 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6j45v\""
Jul 06 23:44:29.858775 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 23:44:29.858775 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 23:44:29.858775 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.858731    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 23:44:29.859036 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.859018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 23:44:29.860398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.860378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 23:44:29.869924 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.865971    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 23:44:29.918416 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqljj\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-kube-api-access-hqljj\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918416 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918416 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918416 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918416 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-web-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.918773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-config-out\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:29.919158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:29.918971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.020169 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqljj\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-kube-api-access-hqljj\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.020330 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.020330 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.020330 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.020330 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-web-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-config-out\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.021022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.020825    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.022546 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.021818    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.022546 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.022404    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.022989 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.022839    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.023421 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.023399    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.024706 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.024409    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.025954 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.025489    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.025954 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.025686    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.025954 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.025895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e60614e4-eddf-4b98-abc0-dc02d9868214-config-out\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.026158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.026064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e60614e4-eddf-4b98-abc0-dc02d9868214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.028064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.028815    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-web-config\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.028838    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.029638    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.029919    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.030014    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.030348    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.031171    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.031480 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.031421    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqljj\" (UniqueName: \"kubernetes.io/projected/e60614e4-eddf-4b98-abc0-dc02d9868214-kube-api-access-hqljj\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.032269 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.031990    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e60614e4-eddf-4b98-abc0-dc02d9868214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e60614e4-eddf-4b98-abc0-dc02d9868214\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.141884 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.141778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"95d338cd8e469861b80989f8cce676cee12969040126a8da5e48d000b1620d17"}
Jul 06 23:44:30.142329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.141903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"998163e9ac96b0ecd329add4fb5585e6c03217ea356d3dc35393cc1e93d1fa26"}
Jul 06 23:44:30.142329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.141948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"d504f799f9b35cfe29bacde5d90510cbe6febc4ccb986a856ab661dcd4eb608c"}
Jul 06 23:44:30.142329 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.141992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"016006649b8f72043c66dcf339b691b72905d56f825d93f8addb0fc859d7d5b7"}
Jul 06 23:44:30.150510 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.150459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-976vc" event={"ID":"faefef84-7e31-4ba4-9477-713951e7d3f1","Type":"ContainerStarted","Data":"5c8839d81b028a46f875de91082b48d51e320d449bd11e8dc37ab6f9c9b22b66"}
Jul 06 23:44:30.170751 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.170378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-976vc" podStartSLOduration=66.004922774 podStartE2EDuration="1m7.170357541s" totalImagesPullingTime="1.165434767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:30.166731574 +0000 UTC m=+68.095707373" watchObservedRunningTime="2026-07-06 23:44:30.170357541 +0000 UTC m=+68.099333325"
Jul 06 23:44:30.181731 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.181687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:44:30.498149 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:30.498047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:44:30.982493 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:44:30.982454    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60614e4_eddf_4b98_abc0_dc02d9868214.slice/crio-2c1da2b966c0392113ec8e0d5ab486f410f3dfa28fd38c774a5d6d77783f1ebf WatchSource:0}: Error finding container 2c1da2b966c0392113ec8e0d5ab486f410f3dfa28fd38c774a5d6d77783f1ebf: Status 404 returned error can't find the container with id 2c1da2b966c0392113ec8e0d5ab486f410f3dfa28fd38c774a5d6d77783f1ebf
Jul 06 23:44:31.156158 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:31.156117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"2c1da2b966c0392113ec8e0d5ab486f410f3dfa28fd38c774a5d6d77783f1ebf"}
Jul 06 23:44:34.172805 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.172769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8l9p" event={"ID":"13026d5d-808c-48f5-bc32-791a316445d5","Type":"ContainerStarted","Data":"308501a46a46fb938877a8e7a8fc94a9d7c1ddbd93fd100ae4a32fc732998bc8"}
Jul 06 23:44:34.174239 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.174214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf" event={"ID":"b67016e8-faf7-4573-8bee-86986c58c30d","Type":"ContainerStarted","Data":"82c87a1208016e249f526acea993cbba245b2707cb5f3b295eea5fab54fdedbb"}
Jul 06 23:44:34.174386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.174366    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:34.175771 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.175745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtlbp" event={"ID":"ddb2e040-9eb0-4271-85fb-7dbd15aceedf","Type":"ContainerStarted","Data":"6a8cc195c35e73c769a6260c67d71e02db6e1eb74fc338ca646fc442d6b979d4"}
Jul 06 23:44:34.175877 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.175802    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:44:34.177371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.177346    2580 generic.go:356] "Generic (PLEG): container finished" podID="e60614e4-eddf-4b98-abc0-dc02d9868214" containerID="f2b1ad98ce9ca492023591e25fbca5ca0f495915f4bfb28c92910a1920d38ffc" exitCode=0
Jul 06 23:44:34.177481 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.177426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerDied","Data":"f2b1ad98ce9ca492023591e25fbca5ca0f495915f4bfb28c92910a1920d38ffc"}
Jul 06 23:44:34.180096 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.180078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf"
Jul 06 23:44:34.180876 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.180860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"726d0e21-30b5-4c61-8233-dd1179b53be6","Type":"ContainerStarted","Data":"d58e22791d8ddd26e834858739e4f8f32a0e45acb062d3e67c3657249d921fdb"}
Jul 06 23:44:34.190199 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.190146    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8l9p" podStartSLOduration=65.578299229 podStartE2EDuration="1m11.190133789s" totalImagesPullingTime="5.61183456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:34.189222919 +0000 UTC m=+72.118198702" watchObservedRunningTime="2026-07-06 23:44:34.190133789 +0000 UTC m=+72.119109572"
Jul 06 23:44:34.221508 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.221464    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.426056797 podStartE2EDuration="10.22144932s" totalImagesPullingTime="6.779172598s" totalInitContainerRuntime="16.219925ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:34.220347691 +0000 UTC m=+72.149323472" watchObservedRunningTime="2026-07-06 23:44:34.22144932 +0000 UTC m=+72.150425105"
Jul 06 23:44:34.238635 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.238569    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rtlbp" podStartSLOduration=65.841903709 podStartE2EDuration="1m11.238551899s" totalImagesPullingTime="5.39664819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:34.238162098 +0000 UTC m=+72.167137882" watchObservedRunningTime="2026-07-06 23:44:34.238551899 +0000 UTC m=+72.167527681"
Jul 06 23:44:34.253830 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:34.253780    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gwxsf" podStartSLOduration=1.979833246 podStartE2EDuration="6.253762072s" totalImagesPullingTime="4.273928826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:34.253751027 +0000 UTC m=+72.182726812" watchObservedRunningTime="2026-07-06 23:44:34.253762072 +0000 UTC m=+72.182737858"
Jul 06 23:44:38.203659 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:38.203619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"783ffdd2ba14cb734fedcd3cf36f3d22c1cf5d8ab792427f2f2760e0847db82d"}
Jul 06 23:44:38.204073 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:38.203706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"f4b253992ca6af2aec50def2f7c19880ea5add1eb13e1df39c851e545e91f216"}
Jul 06 23:44:40.219596 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:40.219559    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"23c7042b949ce5c3fc720ee5436be48952499a339bd20ffa481a2c935646087a"}
Jul 06 23:44:40.220065 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:40.219644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"ed803eb5a44f05ea7269fe71cb80259ae4e3e9e1d44ca72b2d3d36081ee51cc9"}
Jul 06 23:44:40.220065 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:40.219670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"4c723a84cdeb833deb90f313055171f1c55e25aad05eeb701a495caeabd894b2"}
Jul 06 23:44:40.220065 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:40.219694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e60614e4-eddf-4b98-abc0-dc02d9868214","Type":"ContainerStarted","Data":"15c5b1dedd79e975699af990995fdfd5fb83364049570065cc5075a26c5c5745"}
Jul 06 23:44:40.252413 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:40.252356    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.278357112 podStartE2EDuration="11.252336656s" totalImagesPullingTime="4.952352357s" totalInitContainerRuntime="21.627187ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:44:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:44:40.250331726 +0000 UTC m=+78.179307509" watchObservedRunningTime="2026-07-06 23:44:40.252336656 +0000 UTC m=+78.181312441"
Jul 06 23:44:45.181936 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:44:45.181800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:45:05.188172 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:45:05.188145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rtlbp"
Jul 06 23:45:30.182755 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:45:30.182713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:45:30.201876 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:45:30.201837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:45:30.417739 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:45:30.417715    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:48:13.872978 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.872946    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"]
Jul 06 23:48:13.875168 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.875148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.879322 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.879297    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-v8hd2\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v8hd2\"" type="*v1.Secret"
Jul 06 23:48:13.879322 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.879297    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" podUID="d389c490-f88a-4878-86d2-76dab1c76192" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.879322 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.879297    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 06 23:48:13.879628 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.879606    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 06 23:48:13.880001 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.879981    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 06 23:48:13.880135 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:13.880119    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-246.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-246.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 06 23:48:13.892744 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.892721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"]
Jul 06 23:48:13.914984 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.914960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.915092 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.914991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.915092 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.915015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.915092 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.915073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:13.915199 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:13.915104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6vjj\" (UniqueName: \"kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.015896 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.015863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.015896 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.015901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.016100 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.015919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vjj\" (UniqueName: \"kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.016100 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.015990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.016100 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.016019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.016295 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.016277    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-manifests\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.018101 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.018080    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d389c490-f88a-4878-86d2-76dab1c76192-tmp\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:14.798613 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:14.798583    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 23:48:15.016092 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.016061    2580 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 23:48:15.016549 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.016150    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert podName:d389c490-f88a-4878-86d2-76dab1c76192 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:15.516128699 +0000 UTC m=+293.445104461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert") pod "opendatahub-operator-controller-manager-6688846b76-vdfbt" (UID: "d389c490-f88a-4878-86d2-76dab1c76192") : failed to sync secret cache: timed out waiting for the condition
Jul 06 23:48:15.016549 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.016221    2580 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 06 23:48:15.016549 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.016281    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert podName:d389c490-f88a-4878-86d2-76dab1c76192 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:15.516267482 +0000 UTC m=+293.445243243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert") pod "opendatahub-operator-controller-manager-6688846b76-vdfbt" (UID: "d389c490-f88a-4878-86d2-76dab1c76192") : failed to sync secret cache: timed out waiting for the condition
Jul 06 23:48:15.024278 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.024256    2580 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 06 23:48:15.147009 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.146976    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 23:48:15.289094 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.289057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v8hd2\""
Jul 06 23:48:15.400251 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.400178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 23:48:15.405004 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.404981    2580 projected.go:196] Error preparing data for projected volume kube-api-access-d6vjj for pod opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt: failed to sync configmap cache: timed out waiting for the condition
Jul 06 23:48:15.405138 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:15.405060    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj podName:d389c490-f88a-4878-86d2-76dab1c76192 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:15.905039354 +0000 UTC m=+293.834015120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d6vjj" (UniqueName: "kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj") pod "opendatahub-operator-controller-manager-6688846b76-vdfbt" (UID: "d389c490-f88a-4878-86d2-76dab1c76192") : failed to sync configmap cache: timed out waiting for the condition
Jul 06 23:48:15.479050 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.479023    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 23:48:15.529254 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.529223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.529387 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.529370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.531918 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.531895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.531975 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.531895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d389c490-f88a-4878-86d2-76dab1c76192-webhook-cert\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.932973 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.932936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vjj\" (UniqueName: \"kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.935526 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.935489    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6vjj\" (UniqueName: \"kubernetes.io/projected/d389c490-f88a-4878-86d2-76dab1c76192-kube-api-access-d6vjj\") pod \"opendatahub-operator-controller-manager-6688846b76-vdfbt\" (UID: \"d389c490-f88a-4878-86d2-76dab1c76192\") " pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:15.984636 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:15.984612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:16.141854 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:16.141824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"]
Jul 06 23:48:16.144259 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:16.144235    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd389c490_f88a_4878_86d2_76dab1c76192.slice/crio-6775668d93ea6640c4c17c552503bae0b724fb98c8b360ceab3242a8da42b528 WatchSource:0}: Error finding container 6775668d93ea6640c4c17c552503bae0b724fb98c8b360ceab3242a8da42b528: Status 404 returned error can't find the container with id 6775668d93ea6640c4c17c552503bae0b724fb98c8b360ceab3242a8da42b528
Jul 06 23:48:16.987587 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:16.987524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt" event={"ID":"d389c490-f88a-4878-86d2-76dab1c76192","Type":"ContainerStarted","Data":"6775668d93ea6640c4c17c552503bae0b724fb98c8b360ceab3242a8da42b528"}
Jul 06 23:48:20.004972 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:20.004940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt" event={"ID":"d389c490-f88a-4878-86d2-76dab1c76192","Type":"ContainerStarted","Data":"4c1cbfa9dcbcce4fcd57dcf5ca3d144befe84c3734c88803123bbb4858246f17"}
Jul 06 23:48:21.009653 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:21.009618    2580 generic.go:356] "Generic (PLEG): container finished" podID="d389c490-f88a-4878-86d2-76dab1c76192" containerID="4c1cbfa9dcbcce4fcd57dcf5ca3d144befe84c3734c88803123bbb4858246f17" exitCode=0
Jul 06 23:48:21.010011 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:21.009701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt" event={"ID":"d389c490-f88a-4878-86d2-76dab1c76192","Type":"ContainerDied","Data":"4c1cbfa9dcbcce4fcd57dcf5ca3d144befe84c3734c88803123bbb4858246f17"}
Jul 06 23:48:22.015681 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:22.015645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt" event={"ID":"d389c490-f88a-4878-86d2-76dab1c76192","Type":"ContainerStarted","Data":"b0d3b9347dfbe02af477f6e2ef274892c8031dd057b0d72b04ee5fc167b18c24"}
Jul 06 23:48:22.016074 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:22.015735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:22.043331 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:22.043288    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt" podStartSLOduration=4.846450813 podStartE2EDuration="9.043271988s" totalImagesPullingTime="3.179874872s" totalInitContainerRuntime="1.016946303s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:22.042985367 +0000 UTC m=+299.971961151" watchObservedRunningTime="2026-07-06 23:48:22.043271988 +0000 UTC m=+299.972247772"
Jul 06 23:48:22.504164 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:22.504139    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 23:48:33.021685 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:33.021652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6688846b76-vdfbt"
Jul 06 23:48:35.041708 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.041673    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"]
Jul 06 23:48:35.043675 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.043660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.047084 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.047060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 23:48:35.047600 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.047577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 23:48:35.048552 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.048531    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 23:48:35.048649 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.048580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ndbds\""
Jul 06 23:48:35.048649 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.048601    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 23:48:35.058722 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.058697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"]
Jul 06 23:48:35.184214 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.184182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60461a45-30ce-4d33-873c-a1b2b43a7efd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.184396 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.184233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9z2c\" (UniqueName: \"kubernetes.io/projected/60461a45-30ce-4d33-873c-a1b2b43a7efd-kube-api-access-w9z2c\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.184396 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.184266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60461a45-30ce-4d33-873c-a1b2b43a7efd-tmp\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.284728 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.284687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60461a45-30ce-4d33-873c-a1b2b43a7efd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.284931 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.284746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9z2c\" (UniqueName: \"kubernetes.io/projected/60461a45-30ce-4d33-873c-a1b2b43a7efd-kube-api-access-w9z2c\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.284931 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.284769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60461a45-30ce-4d33-873c-a1b2b43a7efd-tmp\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.287000 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.286967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60461a45-30ce-4d33-873c-a1b2b43a7efd-tmp\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.287204 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.287187    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60461a45-30ce-4d33-873c-a1b2b43a7efd-tls-certs\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.294144 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.294086    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9z2c\" (UniqueName: \"kubernetes.io/projected/60461a45-30ce-4d33-873c-a1b2b43a7efd-kube-api-access-w9z2c\") pod \"kube-auth-proxy-8675bbfddd-cszjd\" (UID: \"60461a45-30ce-4d33-873c-a1b2b43a7efd\") " pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.353617 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.353594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"
Jul 06 23:48:35.505209 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.504588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd"]
Jul 06 23:48:35.507874 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.507792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qbg8k"]
Jul 06 23:48:35.508019 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:35.507990    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60461a45_30ce_4d33_873c_a1b2b43a7efd.slice/crio-bfedddea77ec7a2167e3c992e71c84d8708d6f4b6c9ed4c1429a943261ce92f9 WatchSource:0}: Error finding container bfedddea77ec7a2167e3c992e71c84d8708d6f4b6c9ed4c1429a943261ce92f9: Status 404 returned error can't find the container with id bfedddea77ec7a2167e3c992e71c84d8708d6f4b6c9ed4c1429a943261ce92f9
Jul 06 23:48:35.510785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.510183    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:48:35.511705 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.511686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:35.514869 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.514853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 23:48:35.514964 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.514906    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fbwfd\""
Jul 06 23:48:35.524820 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.524801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qbg8k"]
Jul 06 23:48:35.587756 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.587732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:35.587904 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.587790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtb2l\" (UniqueName: \"kubernetes.io/projected/cac7cd19-5b34-409b-8494-7eea41b8eae2-kube-api-access-mtb2l\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:35.689028 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.688995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:35.689181 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.689064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtb2l\" (UniqueName: \"kubernetes.io/projected/cac7cd19-5b34-409b-8494-7eea41b8eae2-kube-api-access-mtb2l\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:35.689181 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:35.689144    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 23:48:35.689255 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:48:35.689222    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert podName:cac7cd19-5b34-409b-8494-7eea41b8eae2 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:36.189203963 +0000 UTC m=+314.118179724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert") pod "odh-model-controller-7998c67dc4-qbg8k" (UID: "cac7cd19-5b34-409b-8494-7eea41b8eae2") : secret "odh-model-controller-webhook-cert" not found
Jul 06 23:48:35.701302 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:35.701269    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtb2l\" (UniqueName: \"kubernetes.io/projected/cac7cd19-5b34-409b-8494-7eea41b8eae2-kube-api-access-mtb2l\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:36.067717 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.067627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd" event={"ID":"60461a45-30ce-4d33-873c-a1b2b43a7efd","Type":"ContainerStarted","Data":"bfedddea77ec7a2167e3c992e71c84d8708d6f4b6c9ed4c1429a943261ce92f9"}
Jul 06 23:48:36.194345 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.194315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:36.197127 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.197098    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac7cd19-5b34-409b-8494-7eea41b8eae2-cert\") pod \"odh-model-controller-7998c67dc4-qbg8k\" (UID: \"cac7cd19-5b34-409b-8494-7eea41b8eae2\") " pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:36.421857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.421823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:36.508582 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.508550    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qpwx8"]
Jul 06 23:48:36.511584 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.511561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.515136 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.515049    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jt4vd\""
Jul 06 23:48:36.515136 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.515118    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 23:48:36.525099 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.525069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qpwx8"]
Jul 06 23:48:36.570542 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.570514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qbg8k"]
Jul 06 23:48:36.573027 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:36.572998    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac7cd19_5b34_409b_8494_7eea41b8eae2.slice/crio-9433cbfe26b648a9bb0419225f282894837a8751608bfb7578d91fbd52eb1e23 WatchSource:0}: Error finding container 9433cbfe26b648a9bb0419225f282894837a8751608bfb7578d91fbd52eb1e23: Status 404 returned error can't find the container with id 9433cbfe26b648a9bb0419225f282894837a8751608bfb7578d91fbd52eb1e23
Jul 06 23:48:36.598100 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.598076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341de0d-2358-4b13-8195-5c938d1b2404-tls-certs\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.598196 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.598182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j566q\" (UniqueName: \"kubernetes.io/projected/c341de0d-2358-4b13-8195-5c938d1b2404-kube-api-access-j566q\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.698744 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.698656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j566q\" (UniqueName: \"kubernetes.io/projected/c341de0d-2358-4b13-8195-5c938d1b2404-kube-api-access-j566q\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.698907 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.698749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341de0d-2358-4b13-8195-5c938d1b2404-tls-certs\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.701636 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.701612    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341de0d-2358-4b13-8195-5c938d1b2404-tls-certs\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.707249 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.707229    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j566q\" (UniqueName: \"kubernetes.io/projected/c341de0d-2358-4b13-8195-5c938d1b2404-kube-api-access-j566q\") pod \"model-serving-api-54d89bd5fc-qpwx8\" (UID: \"c341de0d-2358-4b13-8195-5c938d1b2404\") " pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.826576 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.826543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:36.969021 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:36.968996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qpwx8"]
Jul 06 23:48:36.971295 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:36.971269    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc341de0d_2358_4b13_8195_5c938d1b2404.slice/crio-e97d7887dc0d7188b7c096d07209d858b26bd890fa143478941c30962cf4e71b WatchSource:0}: Error finding container e97d7887dc0d7188b7c096d07209d858b26bd890fa143478941c30962cf4e71b: Status 404 returned error can't find the container with id e97d7887dc0d7188b7c096d07209d858b26bd890fa143478941c30962cf4e71b
Jul 06 23:48:37.073865 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:37.073828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k" event={"ID":"cac7cd19-5b34-409b-8494-7eea41b8eae2","Type":"ContainerStarted","Data":"9433cbfe26b648a9bb0419225f282894837a8751608bfb7578d91fbd52eb1e23"}
Jul 06 23:48:37.075279 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:37.075238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8" event={"ID":"c341de0d-2358-4b13-8195-5c938d1b2404","Type":"ContainerStarted","Data":"e97d7887dc0d7188b7c096d07209d858b26bd890fa143478941c30962cf4e71b"}
Jul 06 23:48:40.091985 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.091948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd" event={"ID":"60461a45-30ce-4d33-873c-a1b2b43a7efd","Type":"ContainerStarted","Data":"9da74273437879a074ce8bdf4f6a5f88d8c7f66a6704e26432e029cda7520eda"}
Jul 06 23:48:40.093383 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.093363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8" event={"ID":"c341de0d-2358-4b13-8195-5c938d1b2404","Type":"ContainerStarted","Data":"e489dc2aa7150a41ab7e44311205e5e43d806983a062761fff48736050a7ca97"}
Jul 06 23:48:40.093526 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.093454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:40.094633 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.094610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k" event={"ID":"cac7cd19-5b34-409b-8494-7eea41b8eae2","Type":"ContainerStarted","Data":"148f26325f4ff36814e2ce800e7779da051cf09940fc94067a698cd1699037fb"}
Jul 06 23:48:40.094798 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.094726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:40.107894 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.107851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8675bbfddd-cszjd" podStartSLOduration=1.440300831 podStartE2EDuration="5.107835876s" totalImagesPullingTime="3.667535045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:40.107689995 +0000 UTC m=+318.036665778" watchObservedRunningTime="2026-07-06 23:48:40.107835876 +0000 UTC m=+318.036811663"
Jul 06 23:48:40.123832 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.123773    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8" podStartSLOduration=1.508554743 podStartE2EDuration="4.123757663s" totalImagesPullingTime="2.61520292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:40.122804671 +0000 UTC m=+318.051780454" watchObservedRunningTime="2026-07-06 23:48:40.123757663 +0000 UTC m=+318.052733447"
Jul 06 23:48:40.138064 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:40.138006    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k" podStartSLOduration=2.171995359 podStartE2EDuration="5.137977529s" totalImagesPullingTime="2.96598217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:40.13755022 +0000 UTC m=+318.066526005" watchObservedRunningTime="2026-07-06 23:48:40.137977529 +0000 UTC m=+318.066953317"
Jul 06 23:48:41.072211 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.072169    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"]
Jul 06 23:48:41.075581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.075557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.078202 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.078177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 23:48:41.078202 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.078190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-v86s4\""
Jul 06 23:48:41.086673 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.086653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"]
Jul 06 23:48:41.141234 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141234 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qfvq\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-kube-api-access-9qfvq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.141651 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.141542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242569 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242569 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qfvq\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-kube-api-access-9qfvq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.242986 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.242881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.243137 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.243050    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.243267 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.243239    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.243388 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.243366    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.243432 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.243390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.243521 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.243485    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.245258 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.245231    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.245374 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.245357    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.253892 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.253869    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.254022 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.253931    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qfvq\" (UniqueName: \"kubernetes.io/projected/b0ac1f5b-6743-4224-abbc-f4f97e536e43-kube-api-access-9qfvq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678962q2\" (UID: \"b0ac1f5b-6743-4224-abbc-f4f97e536e43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.385675 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.385644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:41.523857 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:41.523830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"]
Jul 06 23:48:41.526115 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:41.526083    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ac1f5b_6743_4224_abbc_f4f97e536e43.slice/crio-34de26375b19afc76bcfb9c13dbab6e756703647c9ada5b3234ad1c96f5ee3a2 WatchSource:0}: Error finding container 34de26375b19afc76bcfb9c13dbab6e756703647c9ada5b3234ad1c96f5ee3a2: Status 404 returned error can't find the container with id 34de26375b19afc76bcfb9c13dbab6e756703647c9ada5b3234ad1c96f5ee3a2
Jul 06 23:48:42.104698 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.104665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2" event={"ID":"b0ac1f5b-6743-4224-abbc-f4f97e536e43","Type":"ContainerStarted","Data":"34de26375b19afc76bcfb9c13dbab6e756703647c9ada5b3234ad1c96f5ee3a2"}
Jul 06 23:48:42.924887 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.924854    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"]
Jul 06 23:48:42.928383 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.928366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:42.932436 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 23:48:42.932436 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932276    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 23:48:42.932436 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932304    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qczgf\""
Jul 06 23:48:42.932436 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932417    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 23:48:42.932736 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932418    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:48:42.932736 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.932481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 23:48:42.937349 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:42.937002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"]
Jul 06 23:48:43.058818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.058789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-metrics-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.058989 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.058872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npxr\" (UniqueName: \"kubernetes.io/projected/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-kube-api-access-5npxr\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.058989 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.058904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-manager-config\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.058989 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.058932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.159588 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.159558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5npxr\" (UniqueName: \"kubernetes.io/projected/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-kube-api-access-5npxr\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.159780 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.159613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-manager-config\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.159780 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.159650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.159780 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.159695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-metrics-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.160415 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.160344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-manager-config\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.162860 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.162837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-metrics-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.162968 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.162864    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-cert\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.170410 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.170387    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npxr\" (UniqueName: \"kubernetes.io/projected/6123c10d-5fc8-4d13-9b7c-9d2ae58042cb-kube-api-access-5npxr\") pod \"lws-controller-manager-6557895b7f-bwj5t\" (UID: \"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb\") " pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:43.240744 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:43.240660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:44.161864 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:44.161814    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:48:44.162180 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:44.161926    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:48:44.162180 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:44.161976    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:48:44.251146 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:44.251113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"]
Jul 06 23:48:44.254542 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:48:44.254511    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6123c10d_5fc8_4d13_9b7c_9d2ae58042cb.slice/crio-47eb60be0b0dcd329723d5b8811004376afe477f16b7e8b9a9eadf4d43000141 WatchSource:0}: Error finding container 47eb60be0b0dcd329723d5b8811004376afe477f16b7e8b9a9eadf4d43000141: Status 404 returned error can't find the container with id 47eb60be0b0dcd329723d5b8811004376afe477f16b7e8b9a9eadf4d43000141
Jul 06 23:48:45.120559 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:45.120326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2" event={"ID":"b0ac1f5b-6743-4224-abbc-f4f97e536e43","Type":"ContainerStarted","Data":"14b74fa49fdecc71582637f50044ec01ed7293bed54031e10daa533f84f6f909"}
Jul 06 23:48:45.121896 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:45.121867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t" event={"ID":"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb","Type":"ContainerStarted","Data":"47eb60be0b0dcd329723d5b8811004376afe477f16b7e8b9a9eadf4d43000141"}
Jul 06 23:48:45.153817 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:45.152965    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2" podStartSLOduration=1.519581043 podStartE2EDuration="4.152941326s" totalImagesPullingTime="2.633360283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:45.150839883 +0000 UTC m=+323.079815668" watchObservedRunningTime="2026-07-06 23:48:45.152941326 +0000 UTC m=+323.081917115"
Jul 06 23:48:45.386904 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:45.386806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:45.392357 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:45.392328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:46.126960 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:46.126928    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:46.128121 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:46.128089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678962q2"
Jul 06 23:48:47.131887 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:47.131849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t" event={"ID":"6123c10d-5fc8-4d13-9b7c-9d2ae58042cb","Type":"ContainerStarted","Data":"9c49036cfb1a0512ee22cb4687fb2d12a726c4ebd0348a9bf7e210f7e47c2668"}
Jul 06 23:48:47.132273 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:47.132110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:48:47.152783 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:47.152729    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t" podStartSLOduration=2.792840156 podStartE2EDuration="5.152711512s" totalImagesPullingTime="2.359871356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:47.151787333 +0000 UTC m=+325.080763118" watchObservedRunningTime="2026-07-06 23:48:47.152711512 +0000 UTC m=+325.081687296"
Jul 06 23:48:51.101425 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:51.101391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qbg8k"
Jul 06 23:48:51.103550 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:51.103530    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qpwx8"
Jul 06 23:48:58.139903 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:48:58.139868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6557895b7f-bwj5t"
Jul 06 23:50:17.959430 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.959394    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"]
Jul 06 23:50:17.961956 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.961941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:17.966773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.966752    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 23:50:17.966773 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.966763    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 23:50:17.967005 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.966992    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 23:50:17.968386 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.968347    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 23:50:17.968588 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.968573    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c6m7v\""
Jul 06 23:50:17.974985 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:17.974966    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"]
Jul 06 23:50:18.034222 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.034191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2a96b31-22c9-4846-9570-45e184cab616-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.034398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.034251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvxx\" (UniqueName: \"kubernetes.io/projected/c2a96b31-22c9-4846-9570-45e184cab616-kube-api-access-2rvxx\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.034398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.034276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a96b31-22c9-4846-9570-45e184cab616-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.135083 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.135053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvxx\" (UniqueName: \"kubernetes.io/projected/c2a96b31-22c9-4846-9570-45e184cab616-kube-api-access-2rvxx\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.135271 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.135096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a96b31-22c9-4846-9570-45e184cab616-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.135271 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.135157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2a96b31-22c9-4846-9570-45e184cab616-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.135859 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.135834    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2a96b31-22c9-4846-9570-45e184cab616-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.137561 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.137531    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a96b31-22c9-4846-9570-45e184cab616-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.145108 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.145090    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvxx\" (UniqueName: \"kubernetes.io/projected/c2a96b31-22c9-4846-9570-45e184cab616-kube-api-access-2rvxx\") pod \"kuadrant-console-plugin-66b5774985-tlxck\" (UID: \"c2a96b31-22c9-4846-9570-45e184cab616\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.282255 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.282161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"
Jul 06 23:50:18.413785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.413755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck"]
Jul 06 23:50:18.415967 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:50:18.415942    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2a96b31_22c9_4846_9570_45e184cab616.slice/crio-2a9519e89ceb7d6e4bb1da283094823a8374a22957f3bc2a2e9bf74b2afcd830 WatchSource:0}: Error finding container 2a9519e89ceb7d6e4bb1da283094823a8374a22957f3bc2a2e9bf74b2afcd830: Status 404 returned error can't find the container with id 2a9519e89ceb7d6e4bb1da283094823a8374a22957f3bc2a2e9bf74b2afcd830
Jul 06 23:50:18.509025 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:18.508990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck" event={"ID":"c2a96b31-22c9-4846-9570-45e184cab616","Type":"ContainerStarted","Data":"2a9519e89ceb7d6e4bb1da283094823a8374a22957f3bc2a2e9bf74b2afcd830"}
Jul 06 23:50:39.610311 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:39.610270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck" event={"ID":"c2a96b31-22c9-4846-9570-45e184cab616","Type":"ContainerStarted","Data":"b88319b284cc022d680f69d828e804f57bffcbdda0571e041ecee46acc8a3cc1"}
Jul 06 23:50:39.630278 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:50:39.630190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tlxck" podStartSLOduration=1.680620169 podStartE2EDuration="22.630174884s" totalImagesPullingTime="20.949554715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:39.627967844 +0000 UTC m=+437.556943651" watchObservedRunningTime="2026-07-06 23:50:39.630174884 +0000 UTC m=+437.559150668"
Jul 06 23:51:01.394111 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.394068    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"]
Jul 06 23:51:01.446606 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.446571    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"]
Jul 06 23:51:01.446763 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.446684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.450182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.450161    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vc4k6\""
Jul 06 23:51:01.522625 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.522800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.522800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.522800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.522800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.522800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.523007 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/421b7e6d-aafd-470e-870a-fb73c7624e60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.523007 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.523007 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.522841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhh8\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-kube-api-access-dvhh8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.623818 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/421b7e6d-aafd-470e-870a-fb73c7624e60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.623954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhh8\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-kube-api-access-dvhh8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624015 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624313 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624313 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624313 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624278    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624475 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624452    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624554 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624477    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624554 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624491    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.624921 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.624898    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/421b7e6d-aafd-470e-870a-fb73c7624e60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.626522 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.626481    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.626763 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.626745    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.635490 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.635470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhh8\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-kube-api-access-dvhh8\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.635728 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.635711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/421b7e6d-aafd-470e-870a-fb73c7624e60-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-sd8q7\" (UID: \"421b7e6d-aafd-470e-870a-fb73c7624e60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.756911 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.756825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:01.893880 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.893856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"]
Jul 06 23:51:01.897822 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:51:01.897792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421b7e6d_aafd_470e_870a_fb73c7624e60.slice/crio-757d75434036fbdf9d9a02df5b70c46b188da31141cf317e4741387e801a6b26 WatchSource:0}: Error finding container 757d75434036fbdf9d9a02df5b70c46b188da31141cf317e4741387e801a6b26: Status 404 returned error can't find the container with id 757d75434036fbdf9d9a02df5b70c46b188da31141cf317e4741387e801a6b26
Jul 06 23:51:01.900315 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.900271    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:51:01.900403 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.900364    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:51:01.900440 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:01.900402    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:51:02.702785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:02.702753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" event={"ID":"421b7e6d-aafd-470e-870a-fb73c7624e60","Type":"ContainerStarted","Data":"bc705e5504ae258c76bc1f4fa007e14a08655edae4a6e381b95ad7c62bf94b63"}
Jul 06 23:51:02.703151 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:02.702801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" event={"ID":"421b7e6d-aafd-470e-870a-fb73c7624e60","Type":"ContainerStarted","Data":"757d75434036fbdf9d9a02df5b70c46b188da31141cf317e4741387e801a6b26"}
Jul 06 23:51:02.725109 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:02.725064    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" podStartSLOduration=1.725048876 podStartE2EDuration="1.725048876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:02.723446428 +0000 UTC m=+460.652422211" watchObservedRunningTime="2026-07-06 23:51:02.725048876 +0000 UTC m=+460.654024660"
Jul 06 23:51:02.757705 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:02.757684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:02.762157 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:02.762135    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:03.707359 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:03.707324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:03.708343 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:03.708327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:51:19.232543 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.232512    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:19.235011 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.234996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:19.238067 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.238046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sx2lw\""
Jul 06 23:51:19.247113 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.247090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:19.368406 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.368380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mrnm\" (UniqueName: \"kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm\") pod \"authorino-58cd955675-hf4sb\" (UID: \"5d68535a-8983-45bd-a36d-5d25f37fd05c\") " pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:19.445470 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.445439    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:19.448128 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.448111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:19.455453 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.455430    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:19.469579 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.469552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mrnm\" (UniqueName: \"kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm\") pod \"authorino-58cd955675-hf4sb\" (UID: \"5d68535a-8983-45bd-a36d-5d25f37fd05c\") " pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:19.477920 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.477899    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mrnm\" (UniqueName: \"kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm\") pod \"authorino-58cd955675-hf4sb\" (UID: \"5d68535a-8983-45bd-a36d-5d25f37fd05c\") " pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:19.544820 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.544768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:19.570349 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.570326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9m9\" (UniqueName: \"kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9\") pod \"authorino-75d556bd77-xrcph\" (UID: \"5855b17c-ca2f-4e8f-87be-1fcfe271c06e\") " pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:19.667051 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.667021    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:19.669785 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:51:19.669759    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d68535a_8983_45bd_a36d_5d25f37fd05c.slice/crio-6372b5b6b65bdb52b3e7efa52ed896b6b97e44af7986ad2bc54f8371f8e9a1bd WatchSource:0}: Error finding container 6372b5b6b65bdb52b3e7efa52ed896b6b97e44af7986ad2bc54f8371f8e9a1bd: Status 404 returned error can't find the container with id 6372b5b6b65bdb52b3e7efa52ed896b6b97e44af7986ad2bc54f8371f8e9a1bd
Jul 06 23:51:19.670799 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.670776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9m9\" (UniqueName: \"kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9\") pod \"authorino-75d556bd77-xrcph\" (UID: \"5855b17c-ca2f-4e8f-87be-1fcfe271c06e\") " pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:19.679266 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.679245    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9m9\" (UniqueName: \"kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9\") pod \"authorino-75d556bd77-xrcph\" (UID: \"5855b17c-ca2f-4e8f-87be-1fcfe271c06e\") " pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:19.757166 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.757145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:19.773666 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.773631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hf4sb" event={"ID":"5d68535a-8983-45bd-a36d-5d25f37fd05c","Type":"ContainerStarted","Data":"6372b5b6b65bdb52b3e7efa52ed896b6b97e44af7986ad2bc54f8371f8e9a1bd"}
Jul 06 23:51:19.877776 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:19.877750    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:19.880445 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:51:19.880422    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5855b17c_ca2f_4e8f_87be_1fcfe271c06e.slice/crio-7b05954530dacacbeadc33987a69a07e80a422a18b8060a22da8711f9569b773 WatchSource:0}: Error finding container 7b05954530dacacbeadc33987a69a07e80a422a18b8060a22da8711f9569b773: Status 404 returned error can't find the container with id 7b05954530dacacbeadc33987a69a07e80a422a18b8060a22da8711f9569b773
Jul 06 23:51:20.785089 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:20.785052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xrcph" event={"ID":"5855b17c-ca2f-4e8f-87be-1fcfe271c06e","Type":"ContainerStarted","Data":"7b05954530dacacbeadc33987a69a07e80a422a18b8060a22da8711f9569b773"}
Jul 06 23:51:23.799251 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:23.799218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hf4sb" event={"ID":"5d68535a-8983-45bd-a36d-5d25f37fd05c","Type":"ContainerStarted","Data":"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"}
Jul 06 23:51:23.800801 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:23.800774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xrcph" event={"ID":"5855b17c-ca2f-4e8f-87be-1fcfe271c06e","Type":"ContainerStarted","Data":"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"}
Jul 06 23:51:23.860479 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:23.860433    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hf4sb" podStartSLOduration=1.44010773 podStartE2EDuration="4.860418289s" totalImagesPullingTime="3.420310559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:23.851693383 +0000 UTC m=+481.780669166" watchObservedRunningTime="2026-07-06 23:51:23.860418289 +0000 UTC m=+481.789394073"
Jul 06 23:51:23.959072 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:23.959016    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xrcph" podStartSLOduration=1.759319642 podStartE2EDuration="4.958997837s" totalImagesPullingTime="3.199678195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:23.904053205 +0000 UTC m=+481.833028990" watchObservedRunningTime="2026-07-06 23:51:23.958997837 +0000 UTC m=+481.887973628"
Jul 06 23:51:23.959296 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:23.959282    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:25.808733 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:25.808694    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hf4sb" podUID="5d68535a-8983-45bd-a36d-5d25f37fd05c" containerName="authorino" containerID="cri-o://64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de" gracePeriod=30
Jul 06 23:51:26.051684 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.051655    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:26.132835 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.132806    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mrnm\" (UniqueName: \"kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm\") pod \"5d68535a-8983-45bd-a36d-5d25f37fd05c\" (UID: \"5d68535a-8983-45bd-a36d-5d25f37fd05c\") "
Jul 06 23:51:26.134876 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.134846    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm" (OuterVolumeSpecName: "kube-api-access-2mrnm") pod "5d68535a-8983-45bd-a36d-5d25f37fd05c" (UID: "5d68535a-8983-45bd-a36d-5d25f37fd05c"). InnerVolumeSpecName "kube-api-access-2mrnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:26.233560 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.233529    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mrnm\" (UniqueName: \"kubernetes.io/projected/5d68535a-8983-45bd-a36d-5d25f37fd05c-kube-api-access-2mrnm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 06 23:51:26.819447 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.819406    2580 generic.go:356] "Generic (PLEG): container finished" podID="5d68535a-8983-45bd-a36d-5d25f37fd05c" containerID="64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de" exitCode=0
Jul 06 23:51:26.819874 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.819454    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hf4sb"
Jul 06 23:51:26.819874 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.819479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hf4sb" event={"ID":"5d68535a-8983-45bd-a36d-5d25f37fd05c","Type":"ContainerDied","Data":"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"}
Jul 06 23:51:26.819874 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.819538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hf4sb" event={"ID":"5d68535a-8983-45bd-a36d-5d25f37fd05c","Type":"ContainerDied","Data":"6372b5b6b65bdb52b3e7efa52ed896b6b97e44af7986ad2bc54f8371f8e9a1bd"}
Jul 06 23:51:26.819874 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.819565    2580 scope.go:117] "RemoveContainer" containerID="64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"
Jul 06 23:51:26.828371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.828344    2580 scope.go:117] "RemoveContainer" containerID="64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"
Jul 06 23:51:26.828648 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:51:26.828621    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de\": container with ID starting with 64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de not found: ID does not exist" containerID="64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"
Jul 06 23:51:26.828739 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.828655    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de"} err="failed to get container status \"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de\": rpc error: code = NotFound desc = could not find container \"64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de\": container with ID starting with 64044578ed1fba6a5337d027f4d0bf504776979bb3253dee88dd35f40f8aa2de not found: ID does not exist"
Jul 06 23:51:26.836396 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.836376    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:26.840477 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:26.840458    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hf4sb"]
Jul 06 23:51:28.624698 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:28.624666    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d68535a-8983-45bd-a36d-5d25f37fd05c" path="/var/lib/kubelet/pods/5d68535a-8983-45bd-a36d-5d25f37fd05c/volumes"
Jul 06 23:51:48.142916 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.142882    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-88zkp"]
Jul 06 23:51:48.143521 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.143330    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68535a-8983-45bd-a36d-5d25f37fd05c" containerName="authorino"
Jul 06 23:51:48.143521 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.143349    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68535a-8983-45bd-a36d-5d25f37fd05c" containerName="authorino"
Jul 06 23:51:48.143521 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.143457    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68535a-8983-45bd-a36d-5d25f37fd05c" containerName="authorino"
Jul 06 23:51:48.146427 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.146410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.149389 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.149365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 23:51:48.161075 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.161052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-88zkp"]
Jul 06 23:51:48.196534 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.196508    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-88zkp"]
Jul 06 23:51:48.196777 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:51:48.196758    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h5fvr tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-h5fvr tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-88zkp" podUID="493124ef-5f54-4f56-bfa1-b1e5ef409746"
Jul 06 23:51:48.314109 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.314072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.314281 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.314147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5fvr\" (UniqueName: \"kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.415463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.415374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.415463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.415442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5fvr\" (UniqueName: \"kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.418006 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.417981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.425045 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.425015    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5fvr\" (UniqueName: \"kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr\") pod \"authorino-76877994-88zkp\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") " pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.912422 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.912389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:48.919426 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:48.919406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:49.020785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.020752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert\") pod \"493124ef-5f54-4f56-bfa1-b1e5ef409746\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") "
Jul 06 23:51:49.020785 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.020790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5fvr\" (UniqueName: \"kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr\") pod \"493124ef-5f54-4f56-bfa1-b1e5ef409746\" (UID: \"493124ef-5f54-4f56-bfa1-b1e5ef409746\") "
Jul 06 23:51:49.022961 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.022925    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "493124ef-5f54-4f56-bfa1-b1e5ef409746" (UID: "493124ef-5f54-4f56-bfa1-b1e5ef409746"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:49.023066 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.022932    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr" (OuterVolumeSpecName: "kube-api-access-h5fvr") pod "493124ef-5f54-4f56-bfa1-b1e5ef409746" (UID: "493124ef-5f54-4f56-bfa1-b1e5ef409746"). InnerVolumeSpecName "kube-api-access-h5fvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:49.121827 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.121793    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/493124ef-5f54-4f56-bfa1-b1e5ef409746-tls-cert\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 06 23:51:49.121827 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.121821    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5fvr\" (UniqueName: \"kubernetes.io/projected/493124ef-5f54-4f56-bfa1-b1e5ef409746-kube-api-access-h5fvr\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 06 23:51:49.916882 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.916846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-88zkp"
Jul 06 23:51:49.951722 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.951694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-88zkp"]
Jul 06 23:51:49.957336 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:49.957307    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-88zkp"]
Jul 06 23:51:50.624431 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:50.624399    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493124ef-5f54-4f56-bfa1-b1e5ef409746" path="/var/lib/kubelet/pods/493124ef-5f54-4f56-bfa1-b1e5ef409746/volumes"
Jul 06 23:51:52.398955 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.398921    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:52.399351 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.399097    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xrcph" podUID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" containerName="authorino" containerID="cri-o://f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67" gracePeriod=30
Jul 06 23:51:52.657911 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.657851    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:52.754446 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.754414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw9m9\" (UniqueName: \"kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9\") pod \"5855b17c-ca2f-4e8f-87be-1fcfe271c06e\" (UID: \"5855b17c-ca2f-4e8f-87be-1fcfe271c06e\") "
Jul 06 23:51:52.756451 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.756423    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9" (OuterVolumeSpecName: "kube-api-access-jw9m9") pod "5855b17c-ca2f-4e8f-87be-1fcfe271c06e" (UID: "5855b17c-ca2f-4e8f-87be-1fcfe271c06e"). InnerVolumeSpecName "kube-api-access-jw9m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:52.855745 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.855714    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw9m9\" (UniqueName: \"kubernetes.io/projected/5855b17c-ca2f-4e8f-87be-1fcfe271c06e-kube-api-access-jw9m9\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 06 23:51:52.929199 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.929114    2580 generic.go:356] "Generic (PLEG): container finished" podID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" containerID="f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67" exitCode=0
Jul 06 23:51:52.929199 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.929157    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xrcph"
Jul 06 23:51:52.929371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.929207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xrcph" event={"ID":"5855b17c-ca2f-4e8f-87be-1fcfe271c06e","Type":"ContainerDied","Data":"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"}
Jul 06 23:51:52.929371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.929257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xrcph" event={"ID":"5855b17c-ca2f-4e8f-87be-1fcfe271c06e","Type":"ContainerDied","Data":"7b05954530dacacbeadc33987a69a07e80a422a18b8060a22da8711f9569b773"}
Jul 06 23:51:52.929371 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.929276    2580 scope.go:117] "RemoveContainer" containerID="f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"
Jul 06 23:51:52.937710 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.937693    2580 scope.go:117] "RemoveContainer" containerID="f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"
Jul 06 23:51:52.937946 ip-10-0-133-246 kubenswrapper[2580]: E0706 23:51:52.937927    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67\": container with ID starting with f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67 not found: ID does not exist" containerID="f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"
Jul 06 23:51:52.938009 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.937952    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67"} err="failed to get container status \"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67\": rpc error: code = NotFound desc = could not find container \"f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67\": container with ID starting with f4dbcd66ff4d5eae143cd3feb53da9e17f857794c0459d7a6a5f78a29b37ba67 not found: ID does not exist"
Jul 06 23:51:52.956856 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.956826    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:52.965192 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:52.965173    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xrcph"]
Jul 06 23:51:54.624079 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:51:54.624044    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" path="/var/lib/kubelet/pods/5855b17c-ca2f-4e8f-87be-1fcfe271c06e/volumes"
Jul 06 23:52:36.000040 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.000005    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vfpgj"]
Jul 06 23:52:36.000566 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.000548    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" containerName="authorino"
Jul 06 23:52:36.000613 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.000570    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" containerName="authorino"
Jul 06 23:52:36.000664 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.000650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5855b17c-ca2f-4e8f-87be-1fcfe271c06e" containerName="authorino"
Jul 06 23:52:36.005276 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.005255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.009307 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.009289    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 23:52:36.030198 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.030165    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vfpgj"]
Jul 06 23:52:36.112894 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.112862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m42gz\" (UniqueName: \"kubernetes.io/projected/435ac495-b9f6-4075-8e08-d8a8c6863b0f-kube-api-access-m42gz\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.113059 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.112915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/435ac495-b9f6-4075-8e08-d8a8c6863b0f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.213991 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.213953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m42gz\" (UniqueName: \"kubernetes.io/projected/435ac495-b9f6-4075-8e08-d8a8c6863b0f-kube-api-access-m42gz\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.214152 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.214065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/435ac495-b9f6-4075-8e08-d8a8c6863b0f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.214792 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.214773    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/435ac495-b9f6-4075-8e08-d8a8c6863b0f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.275379 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.275303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m42gz\" (UniqueName: \"kubernetes.io/projected/435ac495-b9f6-4075-8e08-d8a8c6863b0f-kube-api-access-m42gz\") pod \"payload-pre-processing-7964457696-vfpgj\" (UID: \"435ac495-b9f6-4075-8e08-d8a8c6863b0f\") " pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.318236 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.318200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:36.494185 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:36.494153    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vfpgj"]
Jul 06 23:52:36.500860 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:52:36.500817    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435ac495_b9f6_4075_8e08_d8a8c6863b0f.slice/crio-14e7e2455ec47fc1b92784ad7c400b663a1e1c308d942e1a84a840e1ea1c5695 WatchSource:0}: Error finding container 14e7e2455ec47fc1b92784ad7c400b663a1e1c308d942e1a84a840e1ea1c5695: Status 404 returned error can't find the container with id 14e7e2455ec47fc1b92784ad7c400b663a1e1c308d942e1a84a840e1ea1c5695
Jul 06 23:52:37.113351 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:37.113309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj" event={"ID":"435ac495-b9f6-4075-8e08-d8a8c6863b0f","Type":"ContainerStarted","Data":"14e7e2455ec47fc1b92784ad7c400b663a1e1c308d942e1a84a840e1ea1c5695"}
Jul 06 23:52:38.122365 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:38.122326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj" event={"ID":"435ac495-b9f6-4075-8e08-d8a8c6863b0f","Type":"ContainerStarted","Data":"d853422325722752b53b855e4887c2c3e6935e0467e9f14ec2561d2f3cd1b892"}
Jul 06 23:52:38.122800 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:38.122402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:38.159122 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:38.158519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj" podStartSLOduration=1.78049521 podStartE2EDuration="3.158476576s" totalImagesPullingTime="1.377981366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:38.154867744 +0000 UTC m=+556.083843529" watchObservedRunningTime="2026-07-06 23:52:38.158476576 +0000 UTC m=+556.087452362"
Jul 06 23:52:44.152099 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.152014    2580 generic.go:356] "Generic (PLEG): container finished" podID="421b7e6d-aafd-470e-870a-fb73c7624e60" containerID="bc705e5504ae258c76bc1f4fa007e14a08655edae4a6e381b95ad7c62bf94b63" exitCode=0
Jul 06 23:52:44.152099 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.152074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" event={"ID":"421b7e6d-aafd-470e-870a-fb73c7624e60","Type":"ContainerDied","Data":"bc705e5504ae258c76bc1f4fa007e14a08655edae4a6e381b95ad7c62bf94b63"}
Jul 06 23:52:44.152538 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.152421    2580 scope.go:117] "RemoveContainer" containerID="bc705e5504ae258c76bc1f4fa007e14a08655edae4a6e381b95ad7c62bf94b63"
Jul 06 23:52:44.153398 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.153365    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:52:44.153469 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.153453    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:52:44.153535 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:44.153518    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 23:52:45.161326 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:45.161288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" event={"ID":"421b7e6d-aafd-470e-870a-fb73c7624e60","Type":"ContainerStarted","Data":"c3e5931d38790b839d6b3e01166c5b4c9ff4552157e4a47b18afba7afb59a5b9"}
Jul 06 23:52:45.758246 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:45.758210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:52:45.759232 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:45.759198    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-sd8q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 06 23:52:45.759468 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:45.759432    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" podUID="421b7e6d-aafd-470e-870a-fb73c7624e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 06 23:52:46.757512 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:46.757450    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-sd8q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 06 23:52:46.758019 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:46.757542    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" podUID="421b7e6d-aafd-470e-870a-fb73c7624e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 06 23:52:47.758281 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:47.757779    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-sd8q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 06 23:52:47.758281 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:47.757848    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" podUID="421b7e6d-aafd-470e-870a-fb73c7624e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 06 23:52:48.707995 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:48.707944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:52:48.757935 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:48.757899    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-sd8q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 06 23:52:48.758216 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:48.758189    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7" podUID="421b7e6d-aafd-470e-870a-fb73c7624e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 06 23:52:49.128891 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:49.128862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-vfpgj"
Jul 06 23:52:49.760999 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:49.760970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:52:49.761876 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:49.761859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-sd8q7"
Jul 06 23:52:55.186891 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.186856    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"]
Jul 06 23:52:55.189266 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.189247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.198171 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.198144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 23:52:55.198300 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.198244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 23:52:55.198437 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.198423    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2qb9\""
Jul 06 23:52:55.200198 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.200180    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 23:52:55.213823 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.213800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"]
Jul 06 23:52:55.286825 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.286825 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.287030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.287030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5djr\" (UniqueName: \"kubernetes.io/projected/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-kube-api-access-p5djr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.287030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.287030 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.286991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.387763 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5djr\" (UniqueName: \"kubernetes.io/projected/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-kube-api-access-p5djr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.387763 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388020 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.387915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388466 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.388404    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388617 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.388464    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.388617 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.388519    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.390565 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.390539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.390783 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.390761    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.404524 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.404485    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5djr\" (UniqueName: \"kubernetes.io/projected/ec6fa07b-e0e3-40d2-af8b-435dc6901a7a-kube-api-access-p5djr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48\" (UID: \"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.499012 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.498919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:52:55.638671 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:55.638648    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"]
Jul 06 23:52:55.641001 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:52:55.640977    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6fa07b_e0e3_40d2_af8b_435dc6901a7a.slice/crio-387c95e3a589cb9ead6851b5a3e2f4e93343b718efe8a9250ec8810279826677 WatchSource:0}: Error finding container 387c95e3a589cb9ead6851b5a3e2f4e93343b718efe8a9250ec8810279826677: Status 404 returned error can't find the container with id 387c95e3a589cb9ead6851b5a3e2f4e93343b718efe8a9250ec8810279826677
Jul 06 23:52:56.217085 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:56.217048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48" event={"ID":"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a","Type":"ContainerStarted","Data":"387c95e3a589cb9ead6851b5a3e2f4e93343b718efe8a9250ec8810279826677"}
Jul 06 23:52:57.222382 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:57.222347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48" event={"ID":"ec6fa07b-e0e3-40d2-af8b-435dc6901a7a","Type":"ContainerStarted","Data":"9fbe4aa4bb0695ab01d4112049d09c0bee901fc44d10c6f12281c932b1738449"}
Jul 06 23:52:57.258882 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:52:57.258835    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48" podStartSLOduration=1.301380157 podStartE2EDuration="2.258818592s" totalImagesPullingTime="957.438435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:57.256218706 +0000 UTC m=+575.185194490" watchObservedRunningTime="2026-07-06 23:52:57.258818592 +0000 UTC m=+575.187794377"
Jul 06 23:53:05.499602 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:05.499565    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:53:05.499989 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:05.499626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:53:05.511862 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:05.511838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:53:06.272963 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:06.272937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48"
Jul 06 23:53:48.228072 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.228040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"]
Jul 06 23:53:48.231245 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.231230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.234182 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.234161    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 23:53:48.240684 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.240665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"]
Jul 06 23:53:48.244469 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.244576 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.244576 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.244650 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7rz\" (UniqueName: \"kubernetes.io/projected/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-kube-api-access-vm7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.244683 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.244715 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.244705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.345861 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.345861 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346074 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346074 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7rz\" (UniqueName: \"kubernetes.io/projected/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-kube-api-access-vm7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346074 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346074 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.345976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346296 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.346272    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346342 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.346293    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.346377 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.346347    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.348240 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.348218    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.348494 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.348478    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.354791 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.354764    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7rz\" (UniqueName: \"kubernetes.io/projected/2c9616c0-fdb5-416c-9acf-1e57beb3ae7b-kube-api-access-vm7rz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs62s\" (UID: \"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.542005 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.541924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:48.674590 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.674567    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"]
Jul 06 23:53:48.676658 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:53:48.676623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9616c0_fdb5_416c_9acf_1e57beb3ae7b.slice/crio-218b046083a9c8048a8c2b382495dffd9df4c51f048c4b3b03d6b93fe600ed9a WatchSource:0}: Error finding container 218b046083a9c8048a8c2b382495dffd9df4c51f048c4b3b03d6b93fe600ed9a: Status 404 returned error can't find the container with id 218b046083a9c8048a8c2b382495dffd9df4c51f048c4b3b03d6b93fe600ed9a
Jul 06 23:53:48.678469 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:48.678449    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:53:49.444991 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:49.444962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s" event={"ID":"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b","Type":"ContainerStarted","Data":"1fad448d4f1a762823139ff72121cd73e479ffb80ab7be184ea60a7f10e1ce89"}
Jul 06 23:53:49.445401 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:49.445023    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s" event={"ID":"2c9616c0-fdb5-416c-9acf-1e57beb3ae7b","Type":"ContainerStarted","Data":"218b046083a9c8048a8c2b382495dffd9df4c51f048c4b3b03d6b93fe600ed9a"}
Jul 06 23:53:49.462683 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:49.462638    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s" podStartSLOduration=1.294573664 podStartE2EDuration="1.462621712s" totalImagesPullingTime="168.048048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:49.461740127 +0000 UTC m=+627.390715910" watchObservedRunningTime="2026-07-06 23:53:49.462621712 +0000 UTC m=+627.391597496"
Jul 06 23:53:55.807283 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.807243    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"]
Jul 06 23:53:55.810771 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.810751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.813467 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.813446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 23:53:55.819259 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.819237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"]
Jul 06 23:53:55.909638 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.909760 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.909830 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.909830 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.909930 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabbe0cd-7196-444d-898b-8e04b1127ae1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:55.909930 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:55.909864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4cl\" (UniqueName: \"kubernetes.io/projected/dabbe0cd-7196-444d-898b-8e04b1127ae1-kube-api-access-tr4cl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010596 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010753 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010753 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabbe0cd-7196-444d-898b-8e04b1127ae1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010753 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4cl\" (UniqueName: \"kubernetes.io/projected/dabbe0cd-7196-444d-898b-8e04b1127ae1-kube-api-access-tr4cl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010753 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.010958 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.010779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.011026 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.011008    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.011089 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.011057    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.011138 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.011087    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.012863 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.012844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabbe0cd-7196-444d-898b-8e04b1127ae1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.013088 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.013073    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabbe0cd-7196-444d-898b-8e04b1127ae1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.020548 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.020530    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4cl\" (UniqueName: \"kubernetes.io/projected/dabbe0cd-7196-444d-898b-8e04b1127ae1-kube-api-access-tr4cl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4\" (UID: \"dabbe0cd-7196-444d-898b-8e04b1127ae1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.120305 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.120277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:53:56.250217 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.250192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"]
Jul 06 23:53:56.252088 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:53:56.252060    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddabbe0cd_7196_444d_898b_8e04b1127ae1.slice/crio-19be5e16cc0452838daf9a2185e9d2796e103c7e1f338f727e7dc2f49cd23436 WatchSource:0}: Error finding container 19be5e16cc0452838daf9a2185e9d2796e103c7e1f338f727e7dc2f49cd23436: Status 404 returned error can't find the container with id 19be5e16cc0452838daf9a2185e9d2796e103c7e1f338f727e7dc2f49cd23436
Jul 06 23:53:56.473489 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.473463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4" event={"ID":"dabbe0cd-7196-444d-898b-8e04b1127ae1","Type":"ContainerStarted","Data":"3b8fc9bfb3ee3690e438bdd8c63dd80a61c530a8ba405c2a201a821315caa640"}
Jul 06 23:53:56.473630 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.473520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4" event={"ID":"dabbe0cd-7196-444d-898b-8e04b1127ae1","Type":"ContainerStarted","Data":"19be5e16cc0452838daf9a2185e9d2796e103c7e1f338f727e7dc2f49cd23436"}
Jul 06 23:53:56.491875 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:56.491831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4" podStartSLOduration=1.3377111130000001 podStartE2EDuration="1.49181552s" totalImagesPullingTime="154.104407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:56.490758171 +0000 UTC m=+634.419733956" watchObservedRunningTime="2026-07-06 23:53:56.49181552 +0000 UTC m=+634.420791304"
Jul 06 23:53:58.542244 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:58.542212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:58.542615 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:58.542295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:58.554630 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:58.554608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:53:59.502810 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:53:59.502787    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs62s"
Jul 06 23:54:06.120767 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:06.120728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:54:06.121191 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:06.120779    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:54:06.133593 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:06.133569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:54:06.532603 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:06.532523    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4"
Jul 06 23:54:44.514535 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.514488    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5787b49598-kqqtk"]
Jul 06 23:54:44.517935 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.517916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.520577 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.520551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 23:54:44.521581 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.521566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sx2lw\""
Jul 06 23:54:44.524360 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.524339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5787b49598-kqqtk"]
Jul 06 23:54:44.635299 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.635272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184a4e55-08d2-4797-92ce-34896df78613-tls-cert\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.635463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.635313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tclz\" (UniqueName: \"kubernetes.io/projected/184a4e55-08d2-4797-92ce-34896df78613-kube-api-access-8tclz\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.735895 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.735850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184a4e55-08d2-4797-92ce-34896df78613-tls-cert\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.736098 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.736039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tclz\" (UniqueName: \"kubernetes.io/projected/184a4e55-08d2-4797-92ce-34896df78613-kube-api-access-8tclz\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.738214 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.738192    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/184a4e55-08d2-4797-92ce-34896df78613-tls-cert\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.746068 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.746048    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tclz\" (UniqueName: \"kubernetes.io/projected/184a4e55-08d2-4797-92ce-34896df78613-kube-api-access-8tclz\") pod \"authorino-5787b49598-kqqtk\" (UID: \"184a4e55-08d2-4797-92ce-34896df78613\") " pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.827224 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.827193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5787b49598-kqqtk"
Jul 06 23:54:44.953491 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:44.953468    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5787b49598-kqqtk"]
Jul 06 23:54:44.956457 ip-10-0-133-246 kubenswrapper[2580]: W0706 23:54:44.956427    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod184a4e55_08d2_4797_92ce_34896df78613.slice/crio-f3c115a9eaa3b5050776feb5701ad30f9a8088c0a9ce7871556ed14d8f2ddc5f WatchSource:0}: Error finding container f3c115a9eaa3b5050776feb5701ad30f9a8088c0a9ce7871556ed14d8f2ddc5f: Status 404 returned error can't find the container with id f3c115a9eaa3b5050776feb5701ad30f9a8088c0a9ce7871556ed14d8f2ddc5f
Jul 06 23:54:45.701463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:45.701364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5787b49598-kqqtk" event={"ID":"184a4e55-08d2-4797-92ce-34896df78613","Type":"ContainerStarted","Data":"3507748cca28ba272a245af26ca46d6e78cf3e9fd9d4e8d58f1836b6c0be93f3"}
Jul 06 23:54:45.701463 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:45.701413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5787b49598-kqqtk" event={"ID":"184a4e55-08d2-4797-92ce-34896df78613","Type":"ContainerStarted","Data":"f3c115a9eaa3b5050776feb5701ad30f9a8088c0a9ce7871556ed14d8f2ddc5f"}
Jul 06 23:54:45.719491 ip-10-0-133-246 kubenswrapper[2580]: I0706 23:54:45.719446    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5787b49598-kqqtk" podStartSLOduration=1.34214022 podStartE2EDuration="1.719429562s" totalImagesPullingTime="377.289342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:45.718605453 +0000 UTC m=+683.647581238" watchObservedRunningTime="2026-07-06 23:54:45.719429562 +0000 UTC m=+683.648405345"
Jul 07 00:08:02.678234 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.678200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:02.681621 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.681606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.684310 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.684289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-27546a9a-openshift-default-dockercfg-24nl5\""
Jul 07 00:08:02.706814 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.706792    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:02.789725 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.789904 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.789904 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.789904 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.790072 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjk8\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.790072 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.789958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.790072 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.790025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.790072 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.790053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.790215 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.790094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.890813 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.890766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.890813 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.890820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891027 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.890935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891066 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891066 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjk8\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891143 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891209 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891190    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891254 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891254 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891355 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891355 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891557 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.891635 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.891591    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.892042 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.892018    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.893186 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.893163    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.893451 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.893433    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.906092 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.906050    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.906283 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.906264    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjk8\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8\") pod \"e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") " pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:02.992564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:02.992464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:03.129065 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.129038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:03.131020 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:08:03.130994    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2d46f9_6488_4488_811e_644302c1b637.slice/crio-fe70c562820d904df85e93567adff801c432a563c95c8927850e17ea9f1f8896 WatchSource:0}: Error finding container fe70c562820d904df85e93567adff801c432a563c95c8927850e17ea9f1f8896: Status 404 returned error can't find the container with id fe70c562820d904df85e93567adff801c432a563c95c8927850e17ea9f1f8896
Jul 07 00:08:03.133155 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.133123    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:08:03.133231 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.133189    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:08:03.133231 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.133225    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:08:03.272085 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.271998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" event={"ID":"ce2d46f9-6488-4488-811e-644302c1b637","Type":"ContainerStarted","Data":"dd51f99a6340cfede2427f026c008cb7f7e69de42618792d1d6a8b114994523a"}
Jul 07 00:08:03.272085 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.272053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" event={"ID":"ce2d46f9-6488-4488-811e-644302c1b637","Type":"ContainerStarted","Data":"fe70c562820d904df85e93567adff801c432a563c95c8927850e17ea9f1f8896"}
Jul 07 00:08:03.296561 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.296483    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" podStartSLOduration=1.296462596 podStartE2EDuration="1.296462596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:03.293605853 +0000 UTC m=+1481.222581642" watchObservedRunningTime="2026-07-07 00:08:03.296462596 +0000 UTC m=+1481.225438381"
Jul 07 00:08:03.992856 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:03.992828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:04.998011 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:04.997982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:05.281186 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:05.281105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:05.282122 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:05.282104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:09.166140 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:09.166109    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:09.166614 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:09.166273    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" podUID="ce2d46f9-6488-4488-811e-644302c1b637" containerName="istio-proxy" containerID="cri-o://dd51f99a6340cfede2427f026c008cb7f7e69de42618792d1d6a8b114994523a" gracePeriod=30
Jul 07 00:08:14.319851 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.319820    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce2d46f9-6488-4488-811e-644302c1b637" containerID="dd51f99a6340cfede2427f026c008cb7f7e69de42618792d1d6a8b114994523a" exitCode=0
Jul 07 00:08:14.320305 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.319895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" event={"ID":"ce2d46f9-6488-4488-811e-644302c1b637","Type":"ContainerDied","Data":"dd51f99a6340cfede2427f026c008cb7f7e69de42618792d1d6a8b114994523a"}
Jul 07 00:08:14.413948 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.413926    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:14.500044 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.499968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500044 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500081    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjjk8\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500219    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:08:14.500491 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500491 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500491 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert\") pod \"ce2d46f9-6488-4488-811e-644302c1b637\" (UID: \"ce2d46f9-6488-4488-811e-644302c1b637\") "
Jul 07 00:08:14.500491 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500413    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:08:14.500491 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500452    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:08:14.500853 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500786    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:08:14.500853 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500811    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:08:14.501017 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500870    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-data\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.501017 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500885    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.501017 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.500894    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-credential-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.502445 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.502420    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:08:14.502549 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.502451    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:08:14.502636 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.502618    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8" (OuterVolumeSpecName: "kube-api-access-wjjk8") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "kube-api-access-wjjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:08:14.502696 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.502616    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce2d46f9-6488-4488-811e-644302c1b637" (UID: "ce2d46f9-6488-4488-811e-644302c1b637"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:08:14.602335 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602313    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-istio-token\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.602335 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602332    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce2d46f9-6488-4488-811e-644302c1b637-istio-podinfo\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.602455 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602342    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjjk8\" (UniqueName: \"kubernetes.io/projected/ce2d46f9-6488-4488-811e-644302c1b637-kube-api-access-wjjk8\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.602455 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602351    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-workload-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.602455 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602361    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce2d46f9-6488-4488-811e-644302c1b637-istiod-ca-cert\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:14.602455 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:14.602370    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce2d46f9-6488-4488-811e-644302c1b637-istio-envoy\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:08:15.325761 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:15.325735    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"
Jul 07 00:08:15.325761 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:15.325750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw" event={"ID":"ce2d46f9-6488-4488-811e-644302c1b637","Type":"ContainerDied","Data":"fe70c562820d904df85e93567adff801c432a563c95c8927850e17ea9f1f8896"}
Jul 07 00:08:15.326175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:15.325808    2580 scope.go:117] "RemoveContainer" containerID="dd51f99a6340cfede2427f026c008cb7f7e69de42618792d1d6a8b114994523a"
Jul 07 00:08:15.345166 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:15.345137    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:15.349631 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:15.349610    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-27546a9a-openshift-default-644b65cd49-ckbjw"]
Jul 07 00:08:16.625748 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:08:16.625717    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2d46f9-6488-4488-811e-644302c1b637" path="/var/lib/kubelet/pods/ce2d46f9-6488-4488-811e-644302c1b637/volumes"
Jul 07 00:11:42.410544 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.410510    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:11:42.411060 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.411041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2d46f9-6488-4488-811e-644302c1b637" containerName="istio-proxy"
Jul 07 00:11:42.411102 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.411065    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2d46f9-6488-4488-811e-644302c1b637" containerName="istio-proxy"
Jul 07 00:11:42.411194 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.411182    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce2d46f9-6488-4488-811e-644302c1b637" containerName="istio-proxy"
Jul 07 00:11:42.417374 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.417356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.421683 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.421665    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e68d4ac7\"/\"default-dockercfg-shdwb\""
Jul 07 00:11:42.422025 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.421998    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e68d4ac7\"/\"openshift-service-ca.crt\""
Jul 07 00:11:42.422137 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.422114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e68d4ac7\"/\"e2e-lifecycle-model-e68d4ac7-kserve-self-signed-certs\""
Jul 07 00:11:42.422201 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.422137    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e68d4ac7\"/\"kube-root-ca.crt\""
Jul 07 00:11:42.423885 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.423866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:11:42.579599 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.579766 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.579766 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.579766 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.579920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.579920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.579865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrcc\" (UniqueName: \"kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680479 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680479 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680479 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrcc\" (UniqueName: \"kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680704 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680704 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680704 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680889 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680862    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680949 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680879    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.680995 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.680985    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.682771 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.682751    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.683028 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.683011    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.687999 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.687982    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrcc\" (UniqueName: \"kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc\") pod \"e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") " pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.727888 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.727852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:42.854341 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:42.854319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:11:42.856961 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:11:42.856931    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2296a74_8d4e_4e0a_b15e_07b013451971.slice/crio-263f0a34f192245fbe4a3452964cc8020e0842dcd43133404c3bbc576bde50d9 WatchSource:0}: Error finding container 263f0a34f192245fbe4a3452964cc8020e0842dcd43133404c3bbc576bde50d9: Status 404 returned error can't find the container with id 263f0a34f192245fbe4a3452964cc8020e0842dcd43133404c3bbc576bde50d9
Jul 07 00:11:43.249429 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:43.249396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" event={"ID":"e2296a74-8d4e-4e0a-b15e-07b013451971","Type":"ContainerStarted","Data":"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"}
Jul 07 00:11:43.249429 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:43.249434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" event={"ID":"e2296a74-8d4e-4e0a-b15e-07b013451971","Type":"ContainerStarted","Data":"263f0a34f192245fbe4a3452964cc8020e0842dcd43133404c3bbc576bde50d9"}
Jul 07 00:11:43.266466 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:43.266418    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" podStartSLOduration=1.266403785 podStartE2EDuration="1.266403785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:11:43.265721069 +0000 UTC m=+1701.194696853" watchObservedRunningTime="2026-07-07 00:11:43.266403785 +0000 UTC m=+1701.195379568"
Jul 07 00:11:52.728904 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:52.728872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:52.729289 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:52.728918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:52.741214 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:52.741183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:11:53.312877 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:11:53.312855    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:12:15.658081 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:15.658048    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:12:30.678931 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:30.678878    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" podUID="e2296a74-8d4e-4e0a-b15e-07b013451971" containerName="main" containerID="cri-o://9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830" gracePeriod=45
Jul 07 00:12:30.930302 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:30.930251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:12:31.103046 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwrcc\" (UniqueName: \"kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103226 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103058    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103226 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103226 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103226 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103226 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103185    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir\") pod \"e2296a74-8d4e-4e0a-b15e-07b013451971\" (UID: \"e2296a74-8d4e-4e0a-b15e-07b013451971\") "
Jul 07 00:12:31.103482 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103345    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache" (OuterVolumeSpecName: "model-cache") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:12:31.103482 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103366    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home" (OuterVolumeSpecName: "home") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:12:31.103612 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103544    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.103612 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103555    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:12:31.103612 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.103565    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.105248 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.105211    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm" (OuterVolumeSpecName: "dshm") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:12:31.105352 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.105333    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc" (OuterVolumeSpecName: "kube-api-access-mwrcc") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "kube-api-access-mwrcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:12:31.105352 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.105342    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e2296a74-8d4e-4e0a-b15e-07b013451971" (UID: "e2296a74-8d4e-4e0a-b15e-07b013451971"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:12:31.204223 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.204131    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwrcc\" (UniqueName: \"kubernetes.io/projected/e2296a74-8d4e-4e0a-b15e-07b013451971-kube-api-access-mwrcc\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.204223 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.204171    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.204223 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.204181    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2296a74-8d4e-4e0a-b15e-07b013451971-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.204223 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.204191    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2296a74-8d4e-4e0a-b15e-07b013451971-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:12:31.473421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.473332    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2296a74-8d4e-4e0a-b15e-07b013451971" containerID="9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830" exitCode=0
Jul 07 00:12:31.473421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.473372    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"
Jul 07 00:12:31.473643 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.473423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" event={"ID":"e2296a74-8d4e-4e0a-b15e-07b013451971","Type":"ContainerDied","Data":"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"}
Jul 07 00:12:31.473643 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.473464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7" event={"ID":"e2296a74-8d4e-4e0a-b15e-07b013451971","Type":"ContainerDied","Data":"263f0a34f192245fbe4a3452964cc8020e0842dcd43133404c3bbc576bde50d9"}
Jul 07 00:12:31.473643 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.473482    2580 scope.go:117] "RemoveContainer" containerID="9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"
Jul 07 00:12:31.482958 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.482943    2580 scope.go:117] "RemoveContainer" containerID="9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"
Jul 07 00:12:31.483208 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:12:31.483191    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830\": container with ID starting with 9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830 not found: ID does not exist" containerID="9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"
Jul 07 00:12:31.483273 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.483220    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830"} err="failed to get container status \"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830\": rpc error: code = NotFound desc = could not find container \"9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830\": container with ID starting with 9395c7ad5d3ab07e9387787718cf43ceb0f95d84262d2b51f14a9620f521d830 not found: ID does not exist"
Jul 07 00:12:31.495985 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.495965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:12:31.497583 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:31.497565    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e68d4ac7/e2e-lifecycle-model-e68d4ac7-kserve-6c94fc448c-vf4q7"]
Jul 07 00:12:32.624868 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:12:32.624834    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2296a74-8d4e-4e0a-b15e-07b013451971" path="/var/lib/kubelet/pods/e2296a74-8d4e-4e0a-b15e-07b013451971/volumes"
Jul 07 00:14:16.056126 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.056092    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:14:16.056725 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.056448    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2296a74-8d4e-4e0a-b15e-07b013451971" containerName="main"
Jul 07 00:14:16.056725 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.056459    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2296a74-8d4e-4e0a-b15e-07b013451971" containerName="main"
Jul 07 00:14:16.056725 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.056547    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2296a74-8d4e-4e0a-b15e-07b013451971" containerName="main"
Jul 07 00:14:16.058875 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.058855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.061931 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.061915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9caaee-openshift-default-dockercfg-wc56c\""
Jul 07 00:14:16.070862 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.070840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:14:16.112149 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112260 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112260 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112260 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdxk\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112260 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112390 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112390 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112390 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.112390 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.112348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213438 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdxk\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213613 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213918 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.213918 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.214024 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.213956    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.214158 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.214123    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.214292 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.214166    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.214292 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.214139    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.214419 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.214397    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.215801 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.215777    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.216079 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.216063    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.221937 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.221915    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.222050 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.222035    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdxk\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk\") pod \"e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") " pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.369446 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.369415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:16.499894 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.499865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:14:16.501561 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:14:16.501533    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6ec9f4_e369_4602_b06f_b1efe4924f42.slice/crio-2f0e2d607b1cc7425a58113bbaedd9243ab9aef01dc2dd9eae26629a33d8e3d4 WatchSource:0}: Error finding container 2f0e2d607b1cc7425a58113bbaedd9243ab9aef01dc2dd9eae26629a33d8e3d4: Status 404 returned error can't find the container with id 2f0e2d607b1cc7425a58113bbaedd9243ab9aef01dc2dd9eae26629a33d8e3d4
Jul 07 00:14:16.503895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.503859    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:16.503959 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.503934    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:16.504003 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.503965    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:16.948639 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.948606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerStarted","Data":"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"}
Jul 07 00:14:16.948816 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.948656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerStarted","Data":"2f0e2d607b1cc7425a58113bbaedd9243ab9aef01dc2dd9eae26629a33d8e3d4"}
Jul 07 00:14:16.970141 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:16.970086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podStartSLOduration=0.970061476 podStartE2EDuration="970.061476ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:16.969655684 +0000 UTC m=+1854.898631469" watchObservedRunningTime="2026-07-07 00:14:16.970061476 +0000 UTC m=+1854.899037261"
Jul 07 00:14:17.370008 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:17.369977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:17.371649 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:17.371618    2580 patch_prober.go:28] interesting pod/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:14:17.371785 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:17.371683    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:14:18.373626 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:18.373596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:18.957387 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:18.957350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:18.958254 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:18.958232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:28.222812 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.222775    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:14:28.226090 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.226070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.229101 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.229082    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0a7418\"/\"openshift-service-ca.crt\""
Jul 07 00:14:28.230332 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.230308    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0a7418\"/\"test-model-0a7418-kserve-self-signed-certs\""
Jul 07 00:14:28.230332 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.230326    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0a7418\"/\"kube-root-ca.crt\""
Jul 07 00:14:28.230487 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.230339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0a7418\"/\"default-dockercfg-fz6s7\""
Jul 07 00:14:28.236371 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.236352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:14:28.328436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.328436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnqsf\" (UniqueName: \"kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.328670 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.328670 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.328670 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.328670 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.328651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429261 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429261 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnqsf\" (UniqueName: \"kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429460 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429460 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429460 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429642 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429814 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429876 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429813    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.429876 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.429846    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.431591 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.431571    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.431772 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.431755    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.439399 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.439354    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnqsf\" (UniqueName: \"kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf\") pod \"test-model-0a7418-kserve-7bcb686d59-cfq4q\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") " pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.535599 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.535494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:28.714333 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:28.714297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:14:28.717232 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:14:28.717208    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27727a05_1d11_4687_a46d_3dc7ca2a38a0.slice/crio-0c4c280d956cb67f73e7620e71d3245b7766eb3a035618f2499c281243337d0b WatchSource:0}: Error finding container 0c4c280d956cb67f73e7620e71d3245b7766eb3a035618f2499c281243337d0b: Status 404 returned error can't find the container with id 0c4c280d956cb67f73e7620e71d3245b7766eb3a035618f2499c281243337d0b
Jul 07 00:14:29.004797 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:29.004752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" event={"ID":"27727a05-1d11-4687-a46d-3dc7ca2a38a0","Type":"ContainerStarted","Data":"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"}
Jul 07 00:14:29.004797 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:29.004798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" event={"ID":"27727a05-1d11-4687-a46d-3dc7ca2a38a0","Type":"ContainerStarted","Data":"0c4c280d956cb67f73e7620e71d3245b7766eb3a035618f2499c281243337d0b"}
Jul 07 00:14:29.023478 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:29.023435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" podStartSLOduration=1.023419968 podStartE2EDuration="1.023419968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:29.022341478 +0000 UTC m=+1866.951317266" watchObservedRunningTime="2026-07-07 00:14:29.023419968 +0000 UTC m=+1866.952395751"
Jul 07 00:14:32.020663 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.020632    2580 generic.go:356] "Generic (PLEG): container finished" podID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerID="c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab" exitCode=0
Jul 07 00:14:32.020971 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.020706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerDied","Data":"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"}
Jul 07 00:14:32.021144 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.021130    2580 scope.go:117] "RemoveContainer" containerID="c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"
Jul 07 00:14:32.022098 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.022073    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:32.022163 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.022151    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:32.022198 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:32.022185    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:14:33.026561 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:33.026523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerStarted","Data":"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"}
Jul 07 00:14:33.370074 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:33.370036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:33.371263 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:33.371235    2580 patch_prober.go:28] interesting pod/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:14:33.371388 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:33.371296    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:14:33.957343 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:33.957308    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:34.369880 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:34.369849    2580 patch_prober.go:28] interesting pod/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:14:34.370249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:34.369926    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:14:35.370544 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:35.370490    2580 patch_prober.go:28] interesting pod/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:14:35.370919 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:35.370568    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:14:36.370828 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:36.370798    2580 patch_prober.go:28] interesting pod/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 00:14:36.371207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:36.370849    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 00:14:37.374266 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:37.374237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:37.375173 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:37.375155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:14:38.536588 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:38.536559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:38.536588 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:38.536599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:38.549196 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:38.549172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:14:39.067943 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:14:39.067918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:15:06.717051 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:06.717016    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:15:21.737250 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:21.737200    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" podUID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" containerName="main" containerID="cri-o://4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5" gracePeriod=45
Jul 07 00:15:21.988513 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:21.988438    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:15:22.135717 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135683    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.135717 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.135936 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.135936 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135762    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.135936 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135784    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnqsf\" (UniqueName: \"kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.135936 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.135824    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs\") pod \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\" (UID: \"27727a05-1d11-4687-a46d-3dc7ca2a38a0\") "
Jul 07 00:15:22.136144 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.136017    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:15:22.136144 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.136031    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:15:22.136144 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.136040    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home" (OuterVolumeSpecName: "home") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:15:22.138004 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.137985    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm" (OuterVolumeSpecName: "dshm") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:15:22.138107 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.138054    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:15:22.138107 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.138067    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf" (OuterVolumeSpecName: "kube-api-access-lnqsf") pod "27727a05-1d11-4687-a46d-3dc7ca2a38a0" (UID: "27727a05-1d11-4687-a46d-3dc7ca2a38a0"). InnerVolumeSpecName "kube-api-access-lnqsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:15:22.236858 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236823    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.236858 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236851    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.236858 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236859    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.236858 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236867    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27727a05-1d11-4687-a46d-3dc7ca2a38a0-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.237090 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236875    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnqsf\" (UniqueName: \"kubernetes.io/projected/27727a05-1d11-4687-a46d-3dc7ca2a38a0-kube-api-access-lnqsf\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.237090 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.236884    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27727a05-1d11-4687-a46d-3dc7ca2a38a0-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:15:22.255300 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.255229    2580 generic.go:356] "Generic (PLEG): container finished" podID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" containerID="4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5" exitCode=0
Jul 07 00:15:22.255300 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.255269    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"
Jul 07 00:15:22.255436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.255300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" event={"ID":"27727a05-1d11-4687-a46d-3dc7ca2a38a0","Type":"ContainerDied","Data":"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"}
Jul 07 00:15:22.255436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.255330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q" event={"ID":"27727a05-1d11-4687-a46d-3dc7ca2a38a0","Type":"ContainerDied","Data":"0c4c280d956cb67f73e7620e71d3245b7766eb3a035618f2499c281243337d0b"}
Jul 07 00:15:22.255436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.255346    2580 scope.go:117] "RemoveContainer" containerID="4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"
Jul 07 00:15:22.264299 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.264277    2580 scope.go:117] "RemoveContainer" containerID="4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"
Jul 07 00:15:22.264639 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:15:22.264619    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5\": container with ID starting with 4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5 not found: ID does not exist" containerID="4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"
Jul 07 00:15:22.264702 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.264647    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5"} err="failed to get container status \"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5\": rpc error: code = NotFound desc = could not find container \"4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5\": container with ID starting with 4630d62c113a480b77329913266ea544760754653e9681022be24daad8bb06e5 not found: ID does not exist"
Jul 07 00:15:22.275819 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.275794    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:15:22.284102 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.284048    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0a7418/test-model-0a7418-kserve-7bcb686d59-cfq4q"]
Jul 07 00:15:22.628410 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:22.628380    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" path="/var/lib/kubelet/pods/27727a05-1d11-4687-a46d-3dc7ca2a38a0/volumes"
Jul 07 00:15:57.466715 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:57.466680    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:15:57.467293 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:15:57.466937    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy" containerID="cri-o://6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b" gracePeriod=30
Jul 07 00:16:02.723288 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.723263    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:16:02.817579 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817579 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817543    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817579 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817626    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817755    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xdxk\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817803    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.817920 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817901    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert\") pod \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\" (UID: \"3a6ec9f4-e369-4602-b06f-b1efe4924f42\") "
Jul 07 00:16:02.818257 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817916    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:02.818257 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.817964    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:02.818363 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.818264    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.818363 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.818284    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-credential-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.818363 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.818298    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-workload-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.818363 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.818348    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:16:02.818555 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.818439    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:02.819918 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.819893    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:02.820013 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.819954    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk" (OuterVolumeSpecName: "kube-api-access-9xdxk") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "kube-api-access-9xdxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:16:02.820267 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.820238    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:16:02.820354 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.820242    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a6ec9f4-e369-4602-b06f-b1efe4924f42" (UID: "3a6ec9f4-e369-4602-b06f-b1efe4924f42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:16:02.919345 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919313    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-podinfo\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.919345 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919340    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-data\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.919345 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919351    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-token\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.919597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919358    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xdxk\" (UniqueName: \"kubernetes.io/projected/3a6ec9f4-e369-4602-b06f-b1efe4924f42-kube-api-access-9xdxk\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.919597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919367    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istio-envoy\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:02.919597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:02.919377    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6ec9f4-e369-4602-b06f-b1efe4924f42-istiod-ca-cert\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:03.442882 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.442848    2580 generic.go:356] "Generic (PLEG): container finished" podID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerID="6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b" exitCode=0
Jul 07 00:16:03.443030 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.442887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerDied","Data":"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"}
Jul 07 00:16:03.443030 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.442895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"
Jul 07 00:16:03.443030 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.442929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9" event={"ID":"3a6ec9f4-e369-4602-b06f-b1efe4924f42","Type":"ContainerDied","Data":"2f0e2d607b1cc7425a58113bbaedd9243ab9aef01dc2dd9eae26629a33d8e3d4"}
Jul 07 00:16:03.443030 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.442950    2580 scope.go:117] "RemoveContainer" containerID="6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"
Jul 07 00:16:03.451838 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.451818    2580 scope.go:117] "RemoveContainer" containerID="c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"
Jul 07 00:16:03.459243 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.459227    2580 scope.go:117] "RemoveContainer" containerID="6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"
Jul 07 00:16:03.459520 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:16:03.459480    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b\": container with ID starting with 6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b not found: ID does not exist" containerID="6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"
Jul 07 00:16:03.459574 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.459525    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b"} err="failed to get container status \"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b\": rpc error: code = NotFound desc = could not find container \"6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b\": container with ID starting with 6b9f004d0ff82d5de563c18554eb44254bf4b60398fa8e81b86c2db9cf08375b not found: ID does not exist"
Jul 07 00:16:03.459574 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.459544    2580 scope.go:117] "RemoveContainer" containerID="c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"
Jul 07 00:16:03.459781 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:16:03.459766    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab\": container with ID starting with c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab not found: ID does not exist" containerID="c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"
Jul 07 00:16:03.459816 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.459784    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab"} err="failed to get container status \"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab\": rpc error: code = NotFound desc = could not find container \"c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab\": container with ID starting with c673a71a69ee14a76f1d69a69ca203a348e4a7984ed0c2e9209ede8638d3f7ab not found: ID does not exist"
Jul 07 00:16:03.464902 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.464880    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:16:03.468526 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:03.468493    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9caaee-openshift-default-65c566fd87-wqwg9"]
Jul 07 00:16:04.625099 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:04.625068    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" path="/var/lib/kubelet/pods/3a6ec9f4-e369-4602-b06f-b1efe4924f42/volumes"
Jul 07 00:16:06.943075 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943039    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943382    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" containerName="main"
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943393    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" containerName="main"
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943402    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943407    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943414    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:16:06.943456 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943419    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:16:06.943695 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943481    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:16:06.943695 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.943489    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="27727a05-1d11-4687-a46d-3dc7ca2a38a0" containerName="main"
Jul 07 00:16:06.948011 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.947993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:06.950660 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.950641    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b7c63b-openshift-default-dockercfg-c8cr9\""
Jul 07 00:16:06.957409 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:06.957385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:07.057974 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.057946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058162 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.057986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058162 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6kr\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058162 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058162 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058322 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058322 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058322 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.058322 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.058307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159371 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159545 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159545 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159545 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159545 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159712 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6kr\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159758 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159908 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159869    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.159956 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.159913    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.160048 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.160022    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.160048 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.160040    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.160614 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.160588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.161890 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.161870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.162105 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.162089    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.168910 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.168885    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6kr\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.170032 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.170008    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token\") pod \"e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") " pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.258320 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.258236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:07.392623 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.392523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:07.395536 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:16:07.395488    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ebb0e0_d990_4fc1_b293_f3a0f90bce90.slice/crio-b58b06c4cc7b03c1eadef50dcb0f4cc7cc970102ef48a3f2d973a0806cafca9b WatchSource:0}: Error finding container b58b06c4cc7b03c1eadef50dcb0f4cc7cc970102ef48a3f2d973a0806cafca9b: Status 404 returned error can't find the container with id b58b06c4cc7b03c1eadef50dcb0f4cc7cc970102ef48a3f2d973a0806cafca9b
Jul 07 00:16:07.398416 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.398356    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:07.398568 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.398447    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:07.398568 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.398489    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:07.462182 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.462155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerStarted","Data":"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"}
Jul 07 00:16:07.462279 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.462209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerStarted","Data":"b58b06c4cc7b03c1eadef50dcb0f4cc7cc970102ef48a3f2d973a0806cafca9b"}
Jul 07 00:16:07.482443 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:07.482396    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podStartSLOduration=1.482380723 podStartE2EDuration="1.482380723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:16:07.480106376 +0000 UTC m=+1965.409082160" watchObservedRunningTime="2026-07-07 00:16:07.482380723 +0000 UTC m=+1965.411356506"
Jul 07 00:16:08.259131 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:08.259098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:08.264460 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:08.264436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:08.467760 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:08.467726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:08.468616 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:08.468599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:20.523557 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.523457    2580 generic.go:356] "Generic (PLEG): container finished" podID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerID="7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30" exitCode=0
Jul 07 00:16:20.523557 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.523537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerDied","Data":"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"}
Jul 07 00:16:20.523965 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.523914    2580 scope.go:117] "RemoveContainer" containerID="7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"
Jul 07 00:16:20.524899 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.524869    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:20.524959 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.524939    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:20.524998 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:20.524977    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 00:16:21.530982 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:21.530951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerStarted","Data":"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"}
Jul 07 00:16:22.259736 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:22.259615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:22.260870 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:22.260839    2580 patch_prober.go:28] interesting pod/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:16:22.260993 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:22.260905    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:16:23.259294 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:23.259252    2580 patch_prober.go:28] interesting pod/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:16:23.259792 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:23.259317    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:16:23.467873 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:23.467835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:24.259021 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:24.258983    2580 patch_prober.go:28] interesting pod/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:16:24.259318 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:24.259286    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:16:25.258769 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:25.258732    2580 patch_prober.go:28] interesting pod/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 07 00:16:25.258932 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:25.258788    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 07 00:16:26.263006 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:26.262977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:26.263915 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:26.263895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:35.726245 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:35.726208    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:35.726842 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:35.726415    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy" containerID="cri-o://609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25" gracePeriod=30
Jul 07 00:16:40.977858 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:40.977833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:41.084902 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.084878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085048 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.084954    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085048 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.084984    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085048 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6kr\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr\") pod \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\" (UID: \"15ebb0e0-d990-4fc1-b293-f3a0f90bce90\") "
Jul 07 00:16:41.085436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085393    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:41.085436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085418    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:16:41.085436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085424    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:41.085631 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085584    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.085631 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085603    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-credential-socket\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.085631 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085617    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istiod-ca-cert\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.085631 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085615    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:41.085912 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.085891    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data" (OuterVolumeSpecName: "istio-data") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:41.087356 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.087332    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token" (OuterVolumeSpecName: "istio-token") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:16:41.087464 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.087392    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:16:41.087706 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.087687    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr" (OuterVolumeSpecName: "kube-api-access-sg6kr") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "kube-api-access-sg6kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:16:41.087763 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.087700    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15ebb0e0-d990-4fc1-b293-f3a0f90bce90" (UID: "15ebb0e0-d990-4fc1-b293-f3a0f90bce90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:16:41.186532 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186483    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-token\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.186532 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186525    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-data\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.186532 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186533    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-envoy\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.186719 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186540    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-istio-podinfo\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.186719 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186548    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-workload-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.186719 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.186559    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6kr\" (UniqueName: \"kubernetes.io/projected/15ebb0e0-d990-4fc1-b293-f3a0f90bce90-kube-api-access-sg6kr\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:16:41.637648 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.637611    2580 generic.go:356] "Generic (PLEG): container finished" podID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerID="609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25" exitCode=0
Jul 07 00:16:41.637809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.637657    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"
Jul 07 00:16:41.637809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.637696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerDied","Data":"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"}
Jul 07 00:16:41.637809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.637745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk" event={"ID":"15ebb0e0-d990-4fc1-b293-f3a0f90bce90","Type":"ContainerDied","Data":"b58b06c4cc7b03c1eadef50dcb0f4cc7cc970102ef48a3f2d973a0806cafca9b"}
Jul 07 00:16:41.637809 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.637768    2580 scope.go:117] "RemoveContainer" containerID="609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"
Jul 07 00:16:41.646361 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.646347    2580 scope.go:117] "RemoveContainer" containerID="7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"
Jul 07 00:16:41.653599 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.653582    2580 scope.go:117] "RemoveContainer" containerID="609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"
Jul 07 00:16:41.653839 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:16:41.653823    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25\": container with ID starting with 609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25 not found: ID does not exist" containerID="609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"
Jul 07 00:16:41.653906 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.653845    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25"} err="failed to get container status \"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25\": rpc error: code = NotFound desc = could not find container \"609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25\": container with ID starting with 609dca06c088267cf61dac95680286ae07778ac800d47f0e4b1ded7eb751bb25 not found: ID does not exist"
Jul 07 00:16:41.653906 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.653860    2580 scope.go:117] "RemoveContainer" containerID="7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"
Jul 07 00:16:41.654069 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:16:41.654054    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30\": container with ID starting with 7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30 not found: ID does not exist" containerID="7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"
Jul 07 00:16:41.654109 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.654072    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30"} err="failed to get container status \"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30\": rpc error: code = NotFound desc = could not find container \"7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30\": container with ID starting with 7626d6b6272ec26485e26c31f285784dce52f0455bdc67b4c8219f961cf53e30 not found: ID does not exist"
Jul 07 00:16:41.662130 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.662109    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:41.669082 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:41.669063    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b7c63b-openshift-default-65cdbcf895-b5hvk"]
Jul 07 00:16:42.624545 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:16:42.624514    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" path="/var/lib/kubelet/pods/15ebb0e0-d990-4fc1-b293-f3a0f90bce90/volumes"
Jul 07 00:17:00.227714 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.227677    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:17:00.228057 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.228001    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:17:00.228057 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.228011    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:17:00.228128 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.228072    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:17:00.228128 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.228083    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6ec9f4-e369-4602-b06f-b1efe4924f42" containerName="istio-proxy"
Jul 07 00:17:00.230959 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.230944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.233822 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.233795    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"kube-root-ca.crt\""
Jul 07 00:17:00.235080 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.235056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"auth-test-model-72e474-kserve-self-signed-certs\""
Jul 07 00:17:00.235184 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.235092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"default-dockercfg-fxg6p\""
Jul 07 00:17:00.235184 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.235177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"openshift-service-ca.crt\""
Jul 07 00:17:00.241418 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.241392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:17:00.354370 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz8sh\" (UniqueName: \"kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.354370 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.354598 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.354598 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.354598 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.354598 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.354477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455304 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz8sh\" (UniqueName: \"kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455304 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455786 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455766    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455833 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455797    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.455936 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.455912    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.457696 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.457664    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.457862 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.457844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.463622 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.463601    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz8sh\" (UniqueName: \"kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh\") pod \"auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") " pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.540249 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.540143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:00.668206 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.668170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:17:00.670563 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:17:00.670540    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42714141_abd2_4c0c_9418_a719623c194a.slice/crio-fa9e61eaf81090968da1c0ffac8ec29c02be7fab277f5e90b778ede7a4a950e7 WatchSource:0}: Error finding container fa9e61eaf81090968da1c0ffac8ec29c02be7fab277f5e90b778ede7a4a950e7: Status 404 returned error can't find the container with id fa9e61eaf81090968da1c0ffac8ec29c02be7fab277f5e90b778ede7a4a950e7
Jul 07 00:17:00.723146 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:00.723121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" event={"ID":"42714141-abd2-4c0c-9418-a719623c194a","Type":"ContainerStarted","Data":"fa9e61eaf81090968da1c0ffac8ec29c02be7fab277f5e90b778ede7a4a950e7"}
Jul 07 00:17:01.729347 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:01.729313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" event={"ID":"42714141-abd2-4c0c-9418-a719623c194a","Type":"ContainerStarted","Data":"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"}
Jul 07 00:17:01.753713 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:01.753666    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" podStartSLOduration=1.753652982 podStartE2EDuration="1.753652982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:17:01.751307185 +0000 UTC m=+2019.680282971" watchObservedRunningTime="2026-07-07 00:17:01.753652982 +0000 UTC m=+2019.682628767"
Jul 07 00:17:10.540814 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:10.540776    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:10.541365 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:10.540830    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:10.553237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:10.553208    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:17:10.779528 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:17:10.779490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:19:11.349024 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:11.348995    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:19:22.930436 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.930361    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:19:22.930796 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.930726    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:19:22.930796 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.930739    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:19:22.930865 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.930814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ebb0e0-d990-4fc1-b293-f3a0f90bce90" containerName="istio-proxy"
Jul 07 00:19:22.933987 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.933972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:22.936816 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.936795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"sub-test-model-72e474-kserve-self-signed-certs\""
Jul 07 00:19:22.942700 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:22.942680    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:19:23.059190 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.059190 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.059421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.059421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.059421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4ncx\" (UniqueName: \"kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.059576 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.059442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160388 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4ncx\" (UniqueName: \"kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160597 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160773 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.160889 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.160871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.161117 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.161093    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.161212 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.161176    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.161212 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.161201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.163166 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.163142    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.163642 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.163623    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.169260 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.169235    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4ncx\" (UniqueName: \"kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx\") pod \"sub-test-model-72e474-kserve-5b59f577fc-vzs4f\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") " pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.243478 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.243425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:23.370957 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:23.370926    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:19:23.373772 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:19:23.373743    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a11ecc6_1734_4e56_8b81_a1e051e488bf.slice/crio-d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1 WatchSource:0}: Error finding container d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1: Status 404 returned error can't find the container with id d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1
Jul 07 00:19:24.362107 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:24.362077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" event={"ID":"0a11ecc6-1734-4e56-8b81-a1e051e488bf","Type":"ContainerStarted","Data":"79874f2f112fcab766aa96b669db23cfd796abe038c749e930eacca64c2d32bd"}
Jul 07 00:19:24.362107 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:24.362114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" event={"ID":"0a11ecc6-1734-4e56-8b81-a1e051e488bf","Type":"ContainerStarted","Data":"d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1"}
Jul 07 00:19:24.382598 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:24.382552    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" podStartSLOduration=2.382536178 podStartE2EDuration="2.382536178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:19:24.381910175 +0000 UTC m=+2162.310885970" watchObservedRunningTime="2026-07-07 00:19:24.382536178 +0000 UTC m=+2162.311511962"
Jul 07 00:19:26.368440 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.368407    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" podUID="42714141-abd2-4c0c-9418-a719623c194a" containerName="main" containerID="cri-o://a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433" gracePeriod=45
Jul 07 00:19:26.612728 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.612706    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:19:26.690193 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690121    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz8sh\" (UniqueName: \"kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690193 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690158    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690193 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690190    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690432 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690432 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690432 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache\") pod \"42714141-abd2-4c0c-9418-a719623c194a\" (UID: \"42714141-abd2-4c0c-9418-a719623c194a\") "
Jul 07 00:19:26.690432 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690374    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:26.690657 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690464    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home" (OuterVolumeSpecName: "home") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:26.690657 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690631    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache" (OuterVolumeSpecName: "model-cache") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:26.690753 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690692    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:26.690753 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.690712    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:26.692393 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.692364    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh" (OuterVolumeSpecName: "kube-api-access-lz8sh") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "kube-api-access-lz8sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:19:26.692518 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.692388    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm" (OuterVolumeSpecName: "dshm") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:26.692518 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.692433    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42714141-abd2-4c0c-9418-a719623c194a" (UID: "42714141-abd2-4c0c-9418-a719623c194a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:19:26.791968 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.791933    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42714141-abd2-4c0c-9418-a719623c194a-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:26.791968 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.791965    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:26.791968 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.791975    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz8sh\" (UniqueName: \"kubernetes.io/projected/42714141-abd2-4c0c-9418-a719623c194a-kube-api-access-lz8sh\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:26.792141 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:26.791983    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42714141-abd2-4c0c-9418-a719623c194a-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:19:27.376774 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.376740    2580 generic.go:356] "Generic (PLEG): container finished" podID="42714141-abd2-4c0c-9418-a719623c194a" containerID="a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433" exitCode=0
Jul 07 00:19:27.377207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.376791    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"
Jul 07 00:19:27.377207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.376831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" event={"ID":"42714141-abd2-4c0c-9418-a719623c194a","Type":"ContainerDied","Data":"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"}
Jul 07 00:19:27.377207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.376878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk" event={"ID":"42714141-abd2-4c0c-9418-a719623c194a","Type":"ContainerDied","Data":"fa9e61eaf81090968da1c0ffac8ec29c02be7fab277f5e90b778ede7a4a950e7"}
Jul 07 00:19:27.377207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.376901    2580 scope.go:117] "RemoveContainer" containerID="a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"
Jul 07 00:19:27.391811 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.391794    2580 scope.go:117] "RemoveContainer" containerID="a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"
Jul 07 00:19:27.392134 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:19:27.392110    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433\": container with ID starting with a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433 not found: ID does not exist" containerID="a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"
Jul 07 00:19:27.392181 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.392142    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433"} err="failed to get container status \"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433\": rpc error: code = NotFound desc = could not find container \"a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433\": container with ID starting with a786325543e9c925b23fcc1187575b7e33eaa325fbb7c1451781781c30950433 not found: ID does not exist"
Jul 07 00:19:27.401415 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.401386    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:19:27.405276 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:27.405257    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/auth-test-model-72e474-kserve-6cdc6cc75f-7rbzk"]
Jul 07 00:19:28.625301 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:28.625264    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42714141-abd2-4c0c-9418-a719623c194a" path="/var/lib/kubelet/pods/42714141-abd2-4c0c-9418-a719623c194a/volumes"
Jul 07 00:19:33.243652 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:33.243620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:33.243998 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:33.243663    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:33.256220 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:33.256198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:19:33.419711 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:19:33.419684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:20:36.491645 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:36.491610    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:20:51.511175 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.511112    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" podUID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" containerName="main" containerID="cri-o://79874f2f112fcab766aa96b669db23cfd796abe038c749e930eacca64c2d32bd" gracePeriod=45
Jul 07 00:20:51.746388 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.746362    2580 generic.go:356] "Generic (PLEG): container finished" podID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" containerID="79874f2f112fcab766aa96b669db23cfd796abe038c749e930eacca64c2d32bd" exitCode=0
Jul 07 00:20:51.746533 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.746435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" event={"ID":"0a11ecc6-1734-4e56-8b81-a1e051e488bf","Type":"ContainerDied","Data":"79874f2f112fcab766aa96b669db23cfd796abe038c749e930eacca64c2d32bd"}
Jul 07 00:20:51.746533 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.746481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f" event={"ID":"0a11ecc6-1734-4e56-8b81-a1e051e488bf","Type":"ContainerDied","Data":"d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1"}
Jul 07 00:20:51.746533 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.746516    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3f38233793d049992e70977518bf7697dda8b3b0def57264bcab4bde27060a1"
Jul 07 00:20:51.758654 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.758634    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:20:51.862621 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.862782 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.862782 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.862782 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862721    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4ncx\" (UniqueName: \"kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.862782 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.862782 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache\") pod \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\" (UID: \"0a11ecc6-1734-4e56-8b81-a1e051e488bf\") "
Jul 07 00:20:51.863053 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.862901    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home" (OuterVolumeSpecName: "home") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:51.863053 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.863010    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:51.863164 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.863064    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:51.863164 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.863106    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:51.864853 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.864821    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm" (OuterVolumeSpecName: "dshm") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:51.864956 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.864852    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:20:51.864956 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.864877    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx" (OuterVolumeSpecName: "kube-api-access-b4ncx") pod "0a11ecc6-1734-4e56-8b81-a1e051e488bf" (UID: "0a11ecc6-1734-4e56-8b81-a1e051e488bf"). InnerVolumeSpecName "kube-api-access-b4ncx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:51.964383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.964341    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:51.964383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.964369    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4ncx\" (UniqueName: \"kubernetes.io/projected/0a11ecc6-1734-4e56-8b81-a1e051e488bf-kube-api-access-b4ncx\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:51.964383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.964379    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:51.964383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.964387    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a11ecc6-1734-4e56-8b81-a1e051e488bf-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:51.964383 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:51.964395    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a11ecc6-1734-4e56-8b81-a1e051e488bf-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:20:52.750863 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:52.750826    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"
Jul 07 00:20:52.768101 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:52.768078    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:20:52.773266 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:52.773243    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/sub-test-model-72e474-kserve-5b59f577fc-vzs4f"]
Jul 07 00:20:54.027743 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.027711    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:20:54.028137 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028067    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42714141-abd2-4c0c-9418-a719623c194a" containerName="main"
Jul 07 00:20:54.028137 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028080    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="42714141-abd2-4c0c-9418-a719623c194a" containerName="main"
Jul 07 00:20:54.028137 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028097    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" containerName="main"
Jul 07 00:20:54.028137 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028103    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" containerName="main"
Jul 07 00:20:54.028280 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028152    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="42714141-abd2-4c0c-9418-a719623c194a" containerName="main"
Jul 07 00:20:54.028280 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.028160    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" containerName="main"
Jul 07 00:20:54.031364 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.031347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.034577 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.034555    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"kube-root-ca.crt\""
Jul 07 00:20:54.034688 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.034608    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"openshift-service-ca.crt\""
Jul 07 00:20:54.035997 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.035978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"default-dockercfg-fxg6p\""
Jul 07 00:20:54.036121 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.036086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72e474\"/\"rate-test-model-72e474-kserve-self-signed-certs\""
Jul 07 00:20:54.041965 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.041944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:20:54.184179 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvtc\" (UniqueName: \"kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.184344 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.184344 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.184344 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.184344 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.184525 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.184372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.285777 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.285777 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.285777 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286024 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286024 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286024 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.285892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvtc\" (UniqueName: \"kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286182 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.286140    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286182 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.286150    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.286291 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.286259    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.288021 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.288001    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.288268 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.288244    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.295022 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.294991    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvtc\" (UniqueName: \"kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc\") pod \"rate-test-model-72e474-kserve-6d866cf8d7-6tztk\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") " pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.340968 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.340935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:20:54.470306 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.470277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:20:54.472276 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:20:54.472250    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c4096d5_08da_48bd_8cf4_73cf835eba41.slice/crio-f0ae5a163608ccb4276c108109aa5171781254cdee5e70db1de22ae03ff54a0f WatchSource:0}: Error finding container f0ae5a163608ccb4276c108109aa5171781254cdee5e70db1de22ae03ff54a0f: Status 404 returned error can't find the container with id f0ae5a163608ccb4276c108109aa5171781254cdee5e70db1de22ae03ff54a0f
Jul 07 00:20:54.625446 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.625415    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a11ecc6-1734-4e56-8b81-a1e051e488bf" path="/var/lib/kubelet/pods/0a11ecc6-1734-4e56-8b81-a1e051e488bf/volumes"
Jul 07 00:20:54.761946 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.761909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" event={"ID":"6c4096d5-08da-48bd-8cf4-73cf835eba41","Type":"ContainerStarted","Data":"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"}
Jul 07 00:20:54.762107 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.761957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" event={"ID":"6c4096d5-08da-48bd-8cf4-73cf835eba41","Type":"ContainerStarted","Data":"f0ae5a163608ccb4276c108109aa5171781254cdee5e70db1de22ae03ff54a0f"}
Jul 07 00:20:54.780913 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:20:54.780864    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" podStartSLOduration=0.78084768 podStartE2EDuration="780.84768ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:54.779735723 +0000 UTC m=+2252.708711511" watchObservedRunningTime="2026-07-07 00:20:54.78084768 +0000 UTC m=+2252.709823477"
Jul 07 00:21:04.341058 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:04.341023    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:21:04.341058 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:04.341065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:21:04.353251 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:04.353232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:21:04.818140 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:04.818065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:21:19.431211 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.431178    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:21:19.434800 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.434782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.437686 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.437661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"default-dockercfg-c7s82\""
Jul 07 00:21:19.439094 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.439075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"rate-test-model-1ea658-kserve-self-signed-certs\""
Jul 07 00:21:19.439173 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.439130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"openshift-service-ca.crt\""
Jul 07 00:21:19.439173 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.439139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1ea658\"/\"kube-root-ca.crt\""
Jul 07 00:21:19.448540 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.448514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:21:19.511718 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.511818 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.511818 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.511818 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.511921 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9sz8\" (UniqueName: \"kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.511921 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.511904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613090 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9sz8\" (UniqueName: \"kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613237 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613591 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613570    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613676 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613623    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.613676 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.613650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.615398 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.615379    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.615816 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.615795    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.621850 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.621828    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9sz8\" (UniqueName: \"kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8\") pod \"rate-test-model-1ea658-kserve-5596887b99-lv4w6\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") " pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.744391 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.744331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:19.878085 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:19.878061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:21:19.880306 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:21:19.880280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ae76966_b75c_4211_b641_e34e520a33c0.slice/crio-3879e05afc7e6b02baa67c4bcb4e087f55cfc98112c49a3588ca69c79a085da8 WatchSource:0}: Error finding container 3879e05afc7e6b02baa67c4bcb4e087f55cfc98112c49a3588ca69c79a085da8: Status 404 returned error can't find the container with id 3879e05afc7e6b02baa67c4bcb4e087f55cfc98112c49a3588ca69c79a085da8
Jul 07 00:21:20.879667 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:20.879635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" event={"ID":"6ae76966-b75c-4211-b641-e34e520a33c0","Type":"ContainerStarted","Data":"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"}
Jul 07 00:21:20.879667 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:20.879679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" event={"ID":"6ae76966-b75c-4211-b641-e34e520a33c0","Type":"ContainerStarted","Data":"3879e05afc7e6b02baa67c4bcb4e087f55cfc98112c49a3588ca69c79a085da8"}
Jul 07 00:21:20.898650 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:20.898608    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" podStartSLOduration=1.898592701 podStartE2EDuration="1.898592701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:21:20.898080198 +0000 UTC m=+2278.827055983" watchObservedRunningTime="2026-07-07 00:21:20.898592701 +0000 UTC m=+2278.827568486"
Jul 07 00:21:29.745425 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:29.745388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:29.745945 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:29.745437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:29.757966 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:29.757942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:21:29.929421 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:21:29.929391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:22:09.754173 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:09.754129    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:22:10.718236 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:10.718206    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:22:24.773781 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:24.773672    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerName="main" containerID="cri-o://dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a" gracePeriod=45
Jul 07 00:22:24.807563 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:24.807528    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.37:8000/ready\": dial tcp 10.133.0.37:8000: connect: connection refused"
Jul 07 00:22:25.028797 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.028734    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:22:25.126171 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126134    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126350 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126350 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126350 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126350 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126321    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvvtc\" (UniqueName: \"kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126624 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache\") pod \"6c4096d5-08da-48bd-8cf4-73cf835eba41\" (UID: \"6c4096d5-08da-48bd-8cf4-73cf835eba41\") "
Jul 07 00:22:25.126624 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126418    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:25.126624 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126537    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home" (OuterVolumeSpecName: "home") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:25.126772 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126675    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:25.126772 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126742    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.126772 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.126764    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.128475 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.128449    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc" (OuterVolumeSpecName: "kube-api-access-fvvtc") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "kube-api-access-fvvtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:22:25.128587 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.128511    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:22:25.128587 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.128511    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm" (OuterVolumeSpecName: "dshm") pod "6c4096d5-08da-48bd-8cf4-73cf835eba41" (UID: "6c4096d5-08da-48bd-8cf4-73cf835eba41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:25.175592 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.175558    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerID="dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a" exitCode=0
Jul 07 00:22:25.175771 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.175611    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"
Jul 07 00:22:25.175771 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.175620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" event={"ID":"6c4096d5-08da-48bd-8cf4-73cf835eba41","Type":"ContainerDied","Data":"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"}
Jul 07 00:22:25.175771 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.175651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk" event={"ID":"6c4096d5-08da-48bd-8cf4-73cf835eba41","Type":"ContainerDied","Data":"f0ae5a163608ccb4276c108109aa5171781254cdee5e70db1de22ae03ff54a0f"}
Jul 07 00:22:25.175771 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.175668    2580 scope.go:117] "RemoveContainer" containerID="dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"
Jul 07 00:22:25.189079 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.189061    2580 scope.go:117] "RemoveContainer" containerID="dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"
Jul 07 00:22:25.189344 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:22:25.189322    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a\": container with ID starting with dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a not found: ID does not exist" containerID="dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"
Jul 07 00:22:25.189416 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.189353    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a"} err="failed to get container status \"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a\": rpc error: code = NotFound desc = could not find container \"dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a\": container with ID starting with dda723b68ead0f5a255d0a220104c5206d24dab8b0eaa998a203c63b11592c5a not found: ID does not exist"
Jul 07 00:22:25.202207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.202182    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:22:25.213094 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.210150    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-72e474/rate-test-model-72e474-kserve-6d866cf8d7-6tztk"]
Jul 07 00:22:25.227802 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.227773    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvvtc\" (UniqueName: \"kubernetes.io/projected/6c4096d5-08da-48bd-8cf4-73cf835eba41-kube-api-access-fvvtc\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.227802 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.227797    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.227942 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.227807    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4096d5-08da-48bd-8cf4-73cf835eba41-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.227942 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.227816    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4096d5-08da-48bd-8cf4-73cf835eba41-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:25.737962 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.737920    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" podUID="6ae76966-b75c-4211-b641-e34e520a33c0" containerName="main" containerID="cri-o://e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8" gracePeriod=45
Jul 07 00:22:25.989453 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:25.989391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:22:26.137262 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137466 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137466 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137466 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137393    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137466 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9sz8\" (UniqueName: \"kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8\") pod \"6ae76966-b75c-4211-b641-e34e520a33c0\" (UID: \"6ae76966-b75c-4211-b641-e34e520a33c0\") "
Jul 07 00:22:26.137895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137656    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:26.137895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137758    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-model-cache\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.137895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137754    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:26.137895 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.137768    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home" (OuterVolumeSpecName: "home") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:26.139676 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.139651    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8" (OuterVolumeSpecName: "kube-api-access-d9sz8") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "kube-api-access-d9sz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:22:26.139676 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.139658    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:22:26.139816 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.139664    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm" (OuterVolumeSpecName: "dshm") pod "6ae76966-b75c-4211-b641-e34e520a33c0" (UID: "6ae76966-b75c-4211-b641-e34e520a33c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:22:26.182820 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.182785    2580 generic.go:356] "Generic (PLEG): container finished" podID="6ae76966-b75c-4211-b641-e34e520a33c0" containerID="e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8" exitCode=0
Jul 07 00:22:26.183007 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.182829    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"
Jul 07 00:22:26.183007 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.182877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" event={"ID":"6ae76966-b75c-4211-b641-e34e520a33c0","Type":"ContainerDied","Data":"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"}
Jul 07 00:22:26.183007 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.182930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6" event={"ID":"6ae76966-b75c-4211-b641-e34e520a33c0","Type":"ContainerDied","Data":"3879e05afc7e6b02baa67c4bcb4e087f55cfc98112c49a3588ca69c79a085da8"}
Jul 07 00:22:26.183007 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.182955    2580 scope.go:117] "RemoveContainer" containerID="e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"
Jul 07 00:22:26.191925 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.191907    2580 scope.go:117] "RemoveContainer" containerID="e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"
Jul 07 00:22:26.192173 ip-10-0-133-246 kubenswrapper[2580]: E0707 00:22:26.192154    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8\": container with ID starting with e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8 not found: ID does not exist" containerID="e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"
Jul 07 00:22:26.192240 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.192184    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8"} err="failed to get container status \"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8\": rpc error: code = NotFound desc = could not find container \"e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8\": container with ID starting with e0851e0433a94b5ad22f923c8ff78f7f55d6a8f5d8290f86eb1e2101e11cf2c8 not found: ID does not exist"
Jul 07 00:22:26.206156 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.206131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:22:26.211544 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.211522    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1ea658/rate-test-model-1ea658-kserve-5596887b99-lv4w6"]
Jul 07 00:22:26.238328 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.238298    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9sz8\" (UniqueName: \"kubernetes.io/projected/6ae76966-b75c-4211-b641-e34e520a33c0-kube-api-access-d9sz8\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.238420 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.238329    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae76966-b75c-4211-b641-e34e520a33c0-tls-certs\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.238420 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.238344    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-dshm\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.238420 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.238352    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-home\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.238420 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.238359    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae76966-b75c-4211-b641-e34e520a33c0-tmp-dir\") on node \"ip-10-0-133-246.ec2.internal\" DevicePath \"\""
Jul 07 00:22:26.625574 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.625543    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae76966-b75c-4211-b641-e34e520a33c0" path="/var/lib/kubelet/pods/6ae76966-b75c-4211-b641-e34e520a33c0/volumes"
Jul 07 00:22:26.625952 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:22:26.625939    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" path="/var/lib/kubelet/pods/6c4096d5-08da-48bd-8cf4-73cf835eba41/volumes"
Jul 07 00:23:02.837040 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:02.836998    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5787b49598-kqqtk_184a4e55-08d2-4797-92ce-34896df78613/authorino/0.log"
Jul 07 00:23:08.322604 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:08.322570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qpwx8_c341de0d-2358-4b13-8195-5c938d1b2404/server/0.log"
Jul 07 00:23:08.443586 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:08.443557    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qbg8k_cac7cd19-5b34-409b-8494-7eea41b8eae2/manager/0.log"
Jul 07 00:23:08.818045 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:08.818020    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-vdfbt_d389c490-f88a-4878-86d2-76dab1c76192/copy-manifests/0.log"
Jul 07 00:23:08.825004 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:08.824979    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-vdfbt_d389c490-f88a-4878-86d2-76dab1c76192/manager/0.log"
Jul 07 00:23:10.281941 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:10.281909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5787b49598-kqqtk_184a4e55-08d2-4797-92ce-34896df78613/authorino/0.log"
Jul 07 00:23:10.633864 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:10.633836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tlxck_c2a96b31-22c9-4846-9570-45e184cab616/kuadrant-console-plugin/0.log"
Jul 07 00:23:11.484699 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:11.484673    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678962q2_b0ac1f5b-6743-4224-abbc-f4f97e536e43/istio-proxy/0.log"
Jul 07 00:23:11.727621 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:11.727594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-cszjd_60461a45-30ce-4d33-873c-a1b2b43a7efd/kube-auth-proxy/0.log"
Jul 07 00:23:11.971218 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:11.971192    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/1.log"
Jul 07 00:23:12.091978 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:12.091953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vfpgj_435ac495-b9f6-4075-8e08-d8a8c6863b0f/payload-pre-processing/0.log"
Jul 07 00:23:12.691939 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:12.691913    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xtn48_ec6fa07b-e0e3-40d2-af8b-435dc6901a7a/main/0.log"
Jul 07 00:23:13.158682 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:13.158653    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cs62s_2c9616c0-fdb5-416c-9acf-1e57beb3ae7b/main/0.log"
Jul 07 00:23:13.284488 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:13.284459    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-4jcp4_dabbe0cd-7196-444d-898b-8e04b1127ae1/main/0.log"
Jul 07 00:23:20.358016 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:20.357989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8l9p_13026d5d-808c-48f5-bc32-791a316445d5/global-pull-secret-syncer/0.log"
Jul 07 00:23:20.451582 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:20.451553    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qmrpq_dd18c354-7ccf-493c-b2c2-cf4faa238f15/konnectivity-agent/0.log"
Jul 07 00:23:20.538813 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:20.538786    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-246.ec2.internal_88d80e9c047815a47898056b987d8c55/haproxy/0.log"
Jul 07 00:23:24.863555 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:24.863518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5787b49598-kqqtk_184a4e55-08d2-4797-92ce-34896df78613/authorino/0.log"
Jul 07 00:23:24.970432 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:24.970357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tlxck_c2a96b31-22c9-4846-9570-45e184cab616/kuadrant-console-plugin/0.log"
Jul 07 00:23:26.873777 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.873747    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/alertmanager/0.log"
Jul 07 00:23:26.897191 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.897173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/config-reloader/0.log"
Jul 07 00:23:26.921309 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.921266    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/kube-rbac-proxy-web/0.log"
Jul 07 00:23:26.946624 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.946569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/kube-rbac-proxy/0.log"
Jul 07 00:23:26.969779 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.969758    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/kube-rbac-proxy-metric/0.log"
Jul 07 00:23:26.989320 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:26.989305    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/prom-label-proxy/0.log"
Jul 07 00:23:27.013891 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.013870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_726d0e21-30b5-4c61-8233-dd1179b53be6/init-config-reloader/0.log"
Jul 07 00:23:27.209743 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.209682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-gwxsf_b67016e8-faf7-4573-8bee-86986c58c30d/monitoring-plugin/0.log"
Jul 07 00:23:27.243968 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.243945    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5lg58_54ca7d56-7210-41b9-9aea-9cd845b8c233/node-exporter/0.log"
Jul 07 00:23:27.267884 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.267864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5lg58_54ca7d56-7210-41b9-9aea-9cd845b8c233/kube-rbac-proxy/0.log"
Jul 07 00:23:27.291590 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.291573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5lg58_54ca7d56-7210-41b9-9aea-9cd845b8c233/init-textfile/0.log"
Jul 07 00:23:27.649840 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.649808    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/prometheus/0.log"
Jul 07 00:23:27.670224 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.670200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/config-reloader/0.log"
Jul 07 00:23:27.693570 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.693549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/thanos-sidecar/0.log"
Jul 07 00:23:27.716770 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.716753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/kube-rbac-proxy-web/0.log"
Jul 07 00:23:27.775689 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.775638    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/kube-rbac-proxy/0.log"
Jul 07 00:23:27.798655 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.798636    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/kube-rbac-proxy-thanos/0.log"
Jul 07 00:23:27.819737 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.819706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e60614e4-eddf-4b98-abc0-dc02d9868214/init-config-reloader/0.log"
Jul 07 00:23:27.851602 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.851579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-j8kg4_e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e/prometheus-operator/0.log"
Jul 07 00:23:27.874096 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:27.874073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-j8kg4_e7eb8ab0-148b-4c6b-b23b-ba15ebddc87e/kube-rbac-proxy/0.log"
Jul 07 00:23:30.485581 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485549    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"]
Jul 07 00:23:30.485928 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485903    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae76966-b75c-4211-b641-e34e520a33c0" containerName="main"
Jul 07 00:23:30.485928 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485913    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae76966-b75c-4211-b641-e34e520a33c0" containerName="main"
Jul 07 00:23:30.485928 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485922    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerName="main"
Jul 07 00:23:30.485928 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485927    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerName="main"
Jul 07 00:23:30.486054 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485980    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c4096d5-08da-48bd-8cf4-73cf835eba41" containerName="main"
Jul 07 00:23:30.486054 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.485990    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae76966-b75c-4211-b641-e34e520a33c0" containerName="main"
Jul 07 00:23:30.488815 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.488801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.491412 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.491390    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmw4w\"/\"openshift-service-ca.crt\""
Jul 07 00:23:30.491552 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.491439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tmw4w\"/\"default-dockercfg-gdztz\""
Jul 07 00:23:30.492772 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.492750    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmw4w\"/\"kube-root-ca.crt\""
Jul 07 00:23:30.504564 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.503826    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"]
Jul 07 00:23:30.603105 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.603079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-podres\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.603245 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.603121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv4bs\" (UniqueName: \"kubernetes.io/projected/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-kube-api-access-qv4bs\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.603245 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.603163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-proc\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.603245 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.603203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-sys\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.603404 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.603284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-lib-modules\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.703871 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.703837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-lib-modules\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.703987 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.703891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-podres\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.703987 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.703920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4bs\" (UniqueName: \"kubernetes.io/projected/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-kube-api-access-qv4bs\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.703987 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.703957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-proc\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.704140 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.704025    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-lib-modules\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.704140 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.704079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-sys\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.704140 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.704087    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-podres\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.704271 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.704170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-proc\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.704271 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.704218    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-sys\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.711833 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.711812    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4bs\" (UniqueName: \"kubernetes.io/projected/5cddb81d-9a88-4b46-8e2c-1eab9decb1fd-kube-api-access-qv4bs\") pod \"perf-node-gather-daemonset-x9hdm\" (UID: \"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd\") " pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.800820 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.800762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:30.924643 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:30.924622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"]
Jul 07 00:23:30.926300 ip-10-0-133-246 kubenswrapper[2580]: W0707 00:23:30.926262    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5cddb81d_9a88_4b46_8e2c_1eab9decb1fd.slice/crio-7c610c5eb48d8499638f0047800f006c3e0c7a4d254974485028423899375c4e WatchSource:0}: Error finding container 7c610c5eb48d8499638f0047800f006c3e0c7a4d254974485028423899375c4e: Status 404 returned error can't find the container with id 7c610c5eb48d8499638f0047800f006c3e0c7a4d254974485028423899375c4e
Jul 07 00:23:31.481672 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:31.481639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm" event={"ID":"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd","Type":"ContainerStarted","Data":"468023b8bacec0699d5d6881aa6a76745a520d40678e2c9a5748b6087c8c18ba"}
Jul 07 00:23:31.481867 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:31.481692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm" event={"ID":"5cddb81d-9a88-4b46-8e2c-1eab9decb1fd","Type":"ContainerStarted","Data":"7c610c5eb48d8499638f0047800f006c3e0c7a4d254974485028423899375c4e"}
Jul 07 00:23:31.481867 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:31.481753    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:31.498724 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:31.498678    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm" podStartSLOduration=1.49866402 podStartE2EDuration="1.49866402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:23:31.496527377 +0000 UTC m=+2409.425503162" watchObservedRunningTime="2026-07-07 00:23:31.49866402 +0000 UTC m=+2409.427639803"
Jul 07 00:23:32.514480 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:32.514456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ft72p_67be5cc5-4b74-48f8-bc91-a34628451205/dns/0.log"
Jul 07 00:23:32.535341 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:32.535319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ft72p_67be5cc5-4b74-48f8-bc91-a34628451205/kube-rbac-proxy/0.log"
Jul 07 00:23:32.706562 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:32.706539    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dw97x_77de6403-df73-40b9-932f-c253c2817424/dns-node-resolver/0.log"
Jul 07 00:23:33.263208 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:33.263175    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d948d5fb4-25fk2_098f5c0d-f7da-475b-9814-950a75b94e87/registry/0.log"
Jul 07 00:23:33.285389 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:33.285360    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kf45g_5e61d95b-ccd9-42cc-bf00-1a9b486610d0/node-ca/0.log"
Jul 07 00:23:34.298418 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:34.298386    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678962q2_b0ac1f5b-6743-4224-abbc-f4f97e536e43/istio-proxy/0.log"
Jul 07 00:23:34.449581 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:34.449553    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-cszjd_60461a45-30ce-4d33-873c-a1b2b43a7efd/kube-auth-proxy/0.log"
Jul 07 00:23:34.507516 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:34.507470    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/0.log"
Jul 07 00:23:34.535377 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:34.535352    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/1.log"
Jul 07 00:23:34.571277 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:34.571219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vfpgj_435ac495-b9f6-4075-8e08-d8a8c6863b0f/payload-pre-processing/0.log"
Jul 07 00:23:35.399696 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:35.399667    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hk8rf_368ec2cb-fdd2-46f5-b2bc-b0babd306a00/serve-healthcheck-canary/0.log"
Jul 07 00:23:36.012322 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:36.012291    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bm5g9_5d4b0d7c-b84a-4278-b083-aa5d85912c1c/kube-rbac-proxy/0.log"
Jul 07 00:23:36.036241 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:36.036217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bm5g9_5d4b0d7c-b84a-4278-b083-aa5d85912c1c/exporter/0.log"
Jul 07 00:23:36.057295 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:36.057274    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bm5g9_5d4b0d7c-b84a-4278-b083-aa5d85912c1c/extractor/0.log"
Jul 07 00:23:37.496291 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:37.496264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tmw4w/perf-node-gather-daemonset-x9hdm"
Jul 07 00:23:38.589313 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:38.589285    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qpwx8_c341de0d-2358-4b13-8195-5c938d1b2404/server/0.log"
Jul 07 00:23:38.657428 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:38.657403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qbg8k_cac7cd19-5b34-409b-8494-7eea41b8eae2/manager/0.log"
Jul 07 00:23:38.865082 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:38.865010    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-vdfbt_d389c490-f88a-4878-86d2-76dab1c76192/manager/0.log"
Jul 07 00:23:38.886813 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:38.886785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6688846b76-vdfbt_d389c490-f88a-4878-86d2-76dab1c76192/copy-manifests/0.log"
Jul 07 00:23:40.282167 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:40.282139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6557895b7f-bwj5t_6123c10d-5fc8-4d13-9b7c-9d2ae58042cb/manager/0.log"
Jul 07 00:23:41.077083 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:41.077057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678962q2_b0ac1f5b-6743-4224-abbc-f4f97e536e43/istio-proxy/0.log"
Jul 07 00:23:41.193947 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:41.193921    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-cszjd_60461a45-30ce-4d33-873c-a1b2b43a7efd/kube-auth-proxy/0.log"
Jul 07 00:23:41.247533 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:41.247486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/0.log"
Jul 07 00:23:41.277488 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:41.277468    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/1.log"
Jul 07 00:23:41.299770 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:41.299710    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vfpgj_435ac495-b9f6-4075-8e08-d8a8c6863b0f/payload-pre-processing/0.log"
Jul 07 00:23:42.613851 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:42.613827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678962q2_b0ac1f5b-6743-4224-abbc-f4f97e536e43/istio-proxy/0.log"
Jul 07 00:23:42.731948 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:42.731922    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8675bbfddd-cszjd_60461a45-30ce-4d33-873c-a1b2b43a7efd/kube-auth-proxy/0.log"
Jul 07 00:23:42.770365 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:42.770339    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/0.log"
Jul 07 00:23:42.801178 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:42.801110    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-sd8q7_421b7e6d-aafd-470e-870a-fb73c7624e60/istio-proxy/1.log"
Jul 07 00:23:42.823835 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:42.823812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vfpgj_435ac495-b9f6-4075-8e08-d8a8c6863b0f/payload-pre-processing/0.log"
Jul 07 00:23:47.337960 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.337914    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/kube-multus-additional-cni-plugins/0.log"
Jul 07 00:23:47.358422 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.358397    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/egress-router-binary-copy/0.log"
Jul 07 00:23:47.378516 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.378481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/cni-plugins/0.log"
Jul 07 00:23:47.399066 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.399047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/bond-cni-plugin/0.log"
Jul 07 00:23:47.420259 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.420232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/routeoverride-cni/0.log"
Jul 07 00:23:47.440666 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.440644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/whereabouts-cni-bincopy/0.log"
Jul 07 00:23:47.461113 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.461089    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nl95z_026dd1c0-6780-4ec9-8386-48ba21752458/whereabouts-cni/0.log"
Jul 07 00:23:47.519537 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.519513    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sc8c8_f2faa5c3-72a7-4604-a6a4-aec505d0e481/kube-multus/0.log"
Jul 07 00:23:47.620789 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.620721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-976vc_faefef84-7e31-4ba4-9477-713951e7d3f1/network-metrics-daemon/0.log"
Jul 07 00:23:47.640766 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:47.640745    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-976vc_faefef84-7e31-4ba4-9477-713951e7d3f1/kube-rbac-proxy/0.log"
Jul 07 00:23:48.894646 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:48.894615    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/ovn-controller/0.log"
Jul 07 00:23:48.912207 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:48.912181    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/ovn-acl-logging/0.log"
Jul 07 00:23:48.940854 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:48.940834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/kube-rbac-proxy-node/0.log"
Jul 07 00:23:48.964202 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:48.964186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 00:23:48.987098 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:48.987082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/northd/0.log"
Jul 07 00:23:49.008433 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:49.008417    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/nbdb/0.log"
Jul 07 00:23:49.033109 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:49.033091    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/sbdb/0.log"
Jul 07 00:23:49.090340 ip-10-0-133-246 kubenswrapper[2580]: I0707 00:23:49.090322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtrpv_9729338b-710d-496c-9bd9-e890fa7f1247/ovnkube-controller/0.log"