Jul 17 21:43:42.989173 ip-10-0-131-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 21:43:42.989185 ip-10-0-131-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 21:43:42.989195 ip-10-0-131-4 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 21:43:42.989533 ip-10-0-131-4 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 21:43:53.105201 ip-10-0-131-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 21:43:53.105222 ip-10-0-131-4 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8bbd77ffb3654daeaf1af05b5bfa8cc1 --
Jul 17 21:45:30.244118 ip-10-0-131-4 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 21:45:30.667712 ip-10-0-131-4 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:45:30.667712 ip-10-0-131-4 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 21:45:30.667712 ip-10-0-131-4 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:45:30.667712 ip-10-0-131-4 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 21:45:30.667712 ip-10-0-131-4 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:45:30.670206 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.670120    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 21:45:30.675296 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675278    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.675296 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675296    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675301    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675304    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675308    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675312    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675315    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675319    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675322    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675325    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675328    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675331    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675334    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675336    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675339    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675341    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675344    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675346    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675349    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675351    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675354    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.675362 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675356    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675359    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675361    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675365    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675367    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675370    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675374    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675377    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675380    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675382    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675385    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675387    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675389    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675392    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675395    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675397    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675400    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675402    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675404    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675407    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.675823 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675410    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675413    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675416    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675418    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675420    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675423    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675425    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675428    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675430    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675433    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675435    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675438    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675441    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675443    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675446    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675449    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675451    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675454    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675456    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675458    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.676346 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675461    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675463    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675465    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675468    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675470    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675473    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675475    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675477    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675480    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675482    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675485    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675487    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675490    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675492    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675495    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675497    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675500    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675502    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675505    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675507    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.676821 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675510    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675512    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675515    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675518    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675520    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675531    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675534    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675537    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675539    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675542    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675546    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675549    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675552    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675555    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675558    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675561    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675563    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.675566    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676272    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.677316 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676278    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676282    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676284    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676287    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676289    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676292    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676295    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676298    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676300    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676303    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676305    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676308    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676310    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676313    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676317    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676321    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676324    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676327    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676330    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.677768 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676333    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676336    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676339    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676341    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676344    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676346    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676349    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676353    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676356    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676359    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676363    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676365    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676368    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676371    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676374    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676376    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676379    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676381    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676384    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676387    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.678258 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676390    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676393    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676395    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676398    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676400    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676404    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676407    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676410    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676413    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676415    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676417    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676420    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676422    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676425    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676428    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676430    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676433    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676435    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676437    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676440    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.678743 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676442    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676444    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676447    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676449    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676453    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676455    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676457    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676460    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676462    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676464    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676468    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676471    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676474    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676477    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676479    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676482    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676484    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676487    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676491    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.679279 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676493    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676495    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676498    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676500    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676503    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676505    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676508    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676510    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676513    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676515    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676517    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676520    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676522    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676524    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676527    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676529    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676531    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676534    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676536    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.676539    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677396    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.679751 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677402    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677405    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677409    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677412    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677414    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677418    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677420    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677423    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677425    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677428    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677431    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677433    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677436    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677438    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677441    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677444    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677447    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677449    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677452    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677454    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.680350 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677457    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677459    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677462    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677465    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677469    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677472    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677475    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677478    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677480    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677483    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677485    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677488    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677490    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677492    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677495    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677497    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677500    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677502    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677505    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677508    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.680908 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677511    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677513    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677516    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677518    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677521    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677523    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677525    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677528    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677530    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677533    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677535    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677538    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677540    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677543    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677546    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677548    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677551    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677553    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677555    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677558    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.681458 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677560    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677563    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677565    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677567    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677570    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677572    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677575    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677577    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677580    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677582    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677584    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677587    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677590    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677592    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677595    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677597    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677601    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677604    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677609    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.682040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677612    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677614    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677616    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677619    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677622    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677625    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677627    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677630    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677632    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677634    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677637    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677641    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677644    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677646    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677649    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677652    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677655    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677658    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.677661    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677743    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 21:45:30.682561 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677754    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677765    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677772    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677778    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677781    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677786    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677790    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677793    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677796    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677799    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677803    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677808    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677811    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677814    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677817    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677820    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677822    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677827    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677829    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677832    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677851    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677855    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677859    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 21:45:30.683127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677862    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677865    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677868    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677871    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677874    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677877    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677880    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677883    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677887    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677891    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677893    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677896    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677899    2570 flags.go:64] FLAG: --enable-server="true"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677902    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677907    2570 flags.go:64] FLAG: --event-burst="100"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677910    2570 flags.go:64] FLAG: --event-qps="50"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677913    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677916    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677919    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677923    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677935    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677938    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677941    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677944    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677947    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 21:45:30.683755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677950    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677953    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677956    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677959    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677963    2570 flags.go:64] FLAG: --feature-gates=""
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677967    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677970    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677973    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677977    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677980    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677983    2570 flags.go:64] FLAG: --help="false"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677985    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677988    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677991    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677994    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.677997    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678001    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678003    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678006    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678009    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678012    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678016    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678019    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678022    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 17 21:45:30.684502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678025    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678027    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678030    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678034    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678037    2570 flags.go:64] FLAG: --lock-file=""
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678040    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678043    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678046    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678051    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678054    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678057    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678059    2570 flags.go:64] FLAG: --logging-format="text"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678063    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678067    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678070    2570 flags.go:64] FLAG: --manifest-url=""
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678073    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678077    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678080    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678084    2570 flags.go:64] FLAG: --max-pods="110"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678087    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678090    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678094    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678097    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678099    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678102    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 21:45:30.685335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678105    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678113    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678115    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678118    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678121    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678125    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678131    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678134    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678137    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678140    2570 flags.go:64] FLAG: --port="10250"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678144    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678147    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0abe06ae375907e8c"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678150    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678153    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678156    2570 flags.go:64] FLAG: --register-node="true"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678159    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678162    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678165    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678168    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678171    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678175    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678178    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678181    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678184    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678187    2570 flags.go:64] FLAG: --runonce="false"
Jul 17 21:45:30.686197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678190    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678193    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678196    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678199    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678201    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678204    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678207    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678210    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678213    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678216    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678219    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678222    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678225    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678228    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678230    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678236    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678239    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678243    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678247    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678250    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678253    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678256    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678259    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678262    2570 flags.go:64] FLAG: --v="2"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678266    2570 flags.go:64] FLAG: --version="false"
Jul 17 21:45:30.686867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678270    2570 flags.go:64] FLAG: --vmodule=""
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678274    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.678278    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678394    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678398    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678401    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678404    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678407    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678410    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678412    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678415    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678418    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678421    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678424    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678427    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678429    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678432    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678434    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678437    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678439    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.687494 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678442    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678444    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678446    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678450    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678454    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678457    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678459    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678462    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678464    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678466    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678469    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678471    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678474    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678476    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678480    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678482    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678485    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678487    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678489    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678492    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.688085 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678495    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678497    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678500    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678502    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678504    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678507    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678509    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678512    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678514    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678516    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678519    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678521    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678524    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678526    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678528    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678531    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678535    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678538    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678540    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678543    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.688582 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678546    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678548    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678551    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678553    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678555    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678558    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678561    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678564    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678566    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678568    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678571    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678573    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678576    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678578    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678581    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678583    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678586    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678588    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678590    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678593    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.689122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678597    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678602    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678606    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678609    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678611    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678614    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678616    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678619    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678622    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678625    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678627    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678630    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678632    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678635    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678638    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678641    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678644    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678646    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678650    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.689602 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678653    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678655    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.678658    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.679146    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.686664    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.686680    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.686699    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.686705    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686762    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686766    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686769    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686772    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686775    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686777    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686780    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.690093 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686782    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686785    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686787    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686790    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686792    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686794    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686797    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686799    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686802    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686804    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686807    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686810    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686815    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686819    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686822    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686825    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686828    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686830    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686834    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.690470 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686855    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686860    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686864    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686867    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686869    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686872    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686874    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686877    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686880    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686883    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686885    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686888    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686891    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686893    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686896    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686898    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686901    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686903    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686906    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686908    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.690929 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686911    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686914    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686916    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686919    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686921    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686924    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686926    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686928    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686931    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686933    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686936    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686938    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686941    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686943    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686946    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686949    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686952    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686954    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686957    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686959    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.691525 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686962    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686964    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686966    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686969    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686971    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686973    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686976    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686978    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686981    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686984    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686986    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686988    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686991    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686994    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686996    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.686999    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687001    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687003    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687006    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687008    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.692040 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687011    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687013    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687015    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687018    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687020    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687024    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687027    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687031    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687034    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687036    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687039    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687042    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687044    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.687049    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687187    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:45:30.692542 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687192    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687195    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687197    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687200    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687203    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687205    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687207    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687210    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687212    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687214    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687217    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687220    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687222    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687225    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687227    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687230    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687233    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687235    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687237    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687240    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:45:30.692931 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687242    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687245    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687247    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687249    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687252    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687255    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687257    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687259    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687262    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687264    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687267    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687269    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687272    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687274    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687276    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687279    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687281    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687283    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687286    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:45:30.693399 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687288    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687290    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687293    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687295    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687298    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687301    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687303    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687306    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687308    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687310    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687313    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687315    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687317    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687320    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687322    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687325    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687328    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687331    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687333    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687336    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:45:30.693877 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687338    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687341    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687343    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687345    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687347    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687350    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687352    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687355    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687357    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687359    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687362    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687364    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687366    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687370    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687373    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687376    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687379    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687382    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687385    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687387    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:45:30.694366 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687390    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687392    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687395    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687397    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687399    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687401    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687405    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687409    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687411    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687414    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687417    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687419    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687421    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687424    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687426    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687430    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687433    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687436    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:45:30.694822 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:30.687439    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.687443    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.688150    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.692023    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.693430    2570 server.go:1019] "Starting client certificate rotation"
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.693525    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:45:30.695316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.693558    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:45:30.697133 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.697117    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:45:30.700555 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.700539    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:45:30.710236 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.710217    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 17 21:45:30.712122 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.712107    2570 log.go:25] "Validated CRI v1 image API"
Jul 17 21:45:30.715424 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.715405    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 21:45:30.717700 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.717681    2570 fs.go:135] Filesystem UUIDs: map[73ef756d-4da8-4c9e-8519-ec7e0990d982:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7fa7b794-46f3-49f3-976c-91ab7671ed9d:/dev/nvme0n1p3]
Jul 17 21:45:30.717760 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.717700    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 21:45:30.724408 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.724292    2570 manager.go:216] Machine: {Timestamp:2026-07-17 21:45:30.723782797 +0000 UTC m=+0.348508965 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099734 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26abcacd3c0f8171587430f5ed24b1 SystemUUID:ec26abca-cd3c-0f81-7158-7430f5ed24b1 BootID:8bbd77ff-b365-4dae-af1a-f05b5bfa8cc1 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:5c:ac:ec:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:5c:ac:ec:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:38:b6:f1:0f:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 21:45:30.724408 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.724397    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 21:45:30.724538 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.724479    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 21:45:30.725081 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.725065    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:45:30.730828 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.730800    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 21:45:30.730984 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.730831    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 21:45:30.731405 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.731395    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 21:45:30.731436 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.731408    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 21:45:30.731436 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.731415    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:45:30.731971 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.731960    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:45:30.733142 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.733132    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 21:45:30.739027 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739014    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:45:30.739156 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739146    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 21:45:30.739196 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739177    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 21:45:30.739196 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739187    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 21:45:30.739196 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739198    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 21:45:30.739300 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739207    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 17 21:45:30.739300 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739216    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 21:45:30.739591 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739580    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:45:30.739623 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.739598    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:45:30.741259 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.741243    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 21:45:30.742424 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.742411    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 21:45:30.742470 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.742442    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 21:45:30.743032 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743020    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 21:45:30.743068 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743041    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 21:45:30.743068 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743051    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 21:45:30.743068 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743059    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 21:45:30.743068 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743067    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743073    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743081    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743087    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743094    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743099    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743108    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 21:45:30.743176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743115    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 21:45:30.743572 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743564    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 21:45:30.743601 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.743575    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 21:45:30.746893 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.746874    2570 server.go:1268] "Started kubelet"
Jul 17 21:45:30.747011 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.746957    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 21:45:30.747080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.746959    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 21:45:30.747080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.747038    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 21:45:30.747858 ip-10-0-131-4 systemd[1]: Started Kubernetes Kubelet.
Jul 17 21:45:30.748249 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.748232    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 21:45:30.749330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.749315    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 21:45:30.750225 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.750189    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 21:45:30.750225 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.750190    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 21:45:30.750522 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.750496    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 21:45:30.752890 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.752068    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-4.ec2.internal.18c331e38c1bad55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-4.ec2.internal,UID:ip-10-0-131-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-4.ec2.internal,},FirstTimestamp:2026-07-17 21:45:30.746809685 +0000 UTC m=+0.371535851,LastTimestamp:2026-07-17 21:45:30.746809685 +0000 UTC m=+0.371535851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-4.ec2.internal,}"
Jul 17 21:45:30.753874 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.753208    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 21:45:30.755507 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.755488    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 21:45:30.755607 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.755490    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 21:45:30.755607 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.755567    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:30.756467 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756374    2570 factory.go:55] Registering systemd factory
Jul 17 21:45:30.756575 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756534    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 17 21:45:30.756575 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756415    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 21:45:30.756575 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756415    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 21:45:30.756711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756579    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 21:45:30.756711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756659    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 21:45:30.756711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756667    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 21:45:30.756817 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756771    2570 factory.go:153] Registering CRI-O factory
Jul 17 21:45:30.756817 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756783    2570 factory.go:223] Registration of the crio container factory successfully
Jul 17 21:45:30.756922 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756834    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 21:45:30.756922 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756878    2570 factory.go:103] Registering Raw factory
Jul 17 21:45:30.756922 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.756897    2570 manager.go:1196] Started watching for new ooms in manager
Jul 17 21:45:30.757312 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.757299    2570 manager.go:349] Starting recovery of all containers
Jul 17 21:45:30.763548 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.763516    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 21:45:30.763644 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.763578    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 21:45:30.768037 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.767919    2570 manager.go:354] Recovery completed
Jul 17 21:45:30.772551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.772537    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.774582 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.774552    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.774639 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.774586    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.774639 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.774596    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.775125 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775110    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 21:45:30.775177 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775126    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 21:45:30.775177 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775145    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:45:30.775177 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775166    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.775811 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775798    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.775879 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775824    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.775879 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.775834    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.776253 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.776242    2570 policy_none.go:49] "None policy: Start"
Jul 17 21:45:30.776287 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.776258    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 21:45:30.776287 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.776268    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 21:45:30.776756 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.776687    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-4.ec2.internal.18c331e38dc35195  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-4.ec2.internal,UID:ip-10-0-131-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-4.ec2.internal,},FirstTimestamp:2026-07-17 21:45:30.774573461 +0000 UTC m=+0.399299631,LastTimestamp:2026-07-17 21:45:30.774573461 +0000 UTC m=+0.399299631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-4.ec2.internal,}"
Jul 17 21:45:30.777111 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.777098    2570 policy_none.go:47] "Start"
Jul 17 21:45:30.786447 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.786366    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-4.ec2.internal.18c331e38dc39525  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-4.ec2.internal,UID:ip-10-0-131-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-4.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-4.ec2.internal,},FirstTimestamp:2026-07-17 21:45:30.774590757 +0000 UTC m=+0.399316924,LastTimestamp:2026-07-17 21:45:30.774590757 +0000 UTC m=+0.399316924,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-4.ec2.internal,}"
Jul 17 21:45:30.793028 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.793002    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbb5b"
Jul 17 21:45:30.796715 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.796624    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-4.ec2.internal.18c331e38dc3b6ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-4.ec2.internal,UID:ip-10-0-131-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-4.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-4.ec2.internal,},FirstTimestamp:2026-07-17 21:45:30.774599407 +0000 UTC m=+0.399325574,LastTimestamp:2026-07-17 21:45:30.774599407 +0000 UTC m=+0.399325574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-4.ec2.internal,}"
Jul 17 21:45:30.799537 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.799512    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbb5b"
Jul 17 21:45:30.805594 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.805577    2570 manager.go:337] "Starting Device Plugin manager"
Jul 17 21:45:30.805669 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.805623    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 21:45:30.805669 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.805636    2570 server.go:87] "Starting device plugin registration server"
Jul 17 21:45:30.805932 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.805910    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 21:45:30.805987 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.805933    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 21:45:30.806039 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.806000    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 21:45:30.806136 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.806090    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 21:45:30.806136 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.806100    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 21:45:30.806708 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.806689    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 21:45:30.806789 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.806741    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:30.855045 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.855009    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 21:45:30.856323 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.856305    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 21:45:30.856415 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.856343    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 21:45:30.856415 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.856365    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 21:45:30.856415 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.856403    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 21:45:30.858986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.858967    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:45:30.906494 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.906453    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.907561 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.907545    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.907620 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.907575    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.907620 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.907585    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.907679 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.907642    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.916274 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.916260    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.916338 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.916281    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-4.ec2.internal\": node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:30.939088 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.939017    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:30.957181 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.957155    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"]
Jul 17 21:45:30.957259 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.957243    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.958138 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.958121    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.958201 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.958151    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.958201 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.958167    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.959620 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.959607    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.959760 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.959745    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.959796 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.959774    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.960300 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960284    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.960361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960314    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.960361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960327    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.960361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960331    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.960361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960349    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.960361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.960358    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.961332 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.961319    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.961372 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.961347    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:30.962025 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.962012    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:30.962074 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.962047    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:30.962074 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:30.962062    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:30.990616 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.990589    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-4.ec2.internal\" not found" node="ip-10-0-131-4.ec2.internal"
Jul 17 21:45:30.995084 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:30.995067    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-4.ec2.internal\" not found" node="ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.039648 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.039618    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.057305 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.057278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.057380 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.057309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.057380 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.057336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7594f29e16e38aefd9e13645c1b3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-4.ec2.internal\" (UID: \"9b7594f29e16e38aefd9e13645c1b3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.140032 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.139985    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.158382 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.158449 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7594f29e16e38aefd9e13645c1b3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-4.ec2.internal\" (UID: \"9b7594f29e16e38aefd9e13645c1b3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.158449 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.158449 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.158540 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b7594f29e16e38aefd9e13645c1b3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-4.ec2.internal\" (UID: \"9b7594f29e16e38aefd9e13645c1b3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.158540 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.158441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bbf25cceae141e44dda00b143173f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal\" (UID: \"5bbf25cceae141e44dda00b143173f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.240718 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.240638    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.292224 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.292198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.299271 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.299250    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:31.341495 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.341465    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.442017 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.441983    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.542626 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.542562    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.643222 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.643189    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.692786 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.692761    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 21:45:31.693349 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.692918    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 21:45:31.744274 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.744244    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.803884 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.803786    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 21:40:31 +0000 UTC" deadline="2028-03-02 17:30:57.337279151 +0000 UTC"
Jul 17 21:45:31.803884 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.803824    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14251h45m25.533457892s"
Jul 17 21:45:31.845140 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.845112    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.927087 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.927059    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:45:31.945456 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:31.945426    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-4.ec2.internal\" not found"
Jul 17 21:45:31.977992 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:31.977960    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbf25cceae141e44dda00b143173f3e.slice/crio-f9045da75d9986cb6d9e881c6f8886f60a995071b81abe948acbe1e6e64baac1 WatchSource:0}: Error finding container f9045da75d9986cb6d9e881c6f8886f60a995071b81abe948acbe1e6e64baac1: Status 404 returned error can't find the container with id f9045da75d9986cb6d9e881c6f8886f60a995071b81abe948acbe1e6e64baac1
Jul 17 21:45:31.978388 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:31.978366    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7594f29e16e38aefd9e13645c1b3bc.slice/crio-63a1e4ea1c50c032ecf9f332fdddf22d2bf12ee6f0e1f0637dc366d58f481ab8 WatchSource:0}: Error finding container 63a1e4ea1c50c032ecf9f332fdddf22d2bf12ee6f0e1f0637dc366d58f481ab8: Status 404 returned error can't find the container with id 63a1e4ea1c50c032ecf9f332fdddf22d2bf12ee6f0e1f0637dc366d58f481ab8
Jul 17 21:45:31.982622 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.982601    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:45:31.983773 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.983753    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:45:31.983885 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.983790    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:45:31.983885 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.983802    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:45:31.983989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.983954    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:45:31.985212 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:31.985198    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:45:32.056047 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:32.055967    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:32.069150 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:32.069125    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:45:32.070336 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:32.070321    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal"
Jul 17 21:45:32.078069 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:32.078052    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:45:32.105405 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:32.105381    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:45:33.885956 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.885924    2570 apiserver.go:52] "Watching apiserver"
Jul 17 21:45:33.892269 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.892244    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 21:45:33.892666 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.892642    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal","openshift-network-diagnostics/network-check-target-tllgr","openshift-ovn-kubernetes/ovnkube-node-7nnm5","kube-system/global-pull-secret-syncer-rnn57","kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn","openshift-image-registry/node-ca-q2vxh","openshift-multus/multus-additional-cni-plugins-sh5j2","openshift-multus/multus-xxxx8","openshift-multus/network-metrics-daemon-vh2zh","openshift-network-operator/iptables-alerter-htbr4","kube-system/konnectivity-agent-8gnd2","openshift-cluster-node-tuning-operator/tuned-wqnws","openshift-dns/node-resolver-hkgbn"]
Jul 17 21:45:33.894108 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.894089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:33.896094 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.896074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:33.897056 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.897039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.898116 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.898095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:33.898230 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:33.898167    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:33.898721 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.898657    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.898838 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.898738    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 21:45:33.898838 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.898805    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899023    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vcsfw\""
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899229    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899255    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sc5s8\""
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899357    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899489    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9brjf\""
Jul 17 21:45:33.899801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899509    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.900151 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899894    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.900151 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 21:45:33.900151 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.899962    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 21:45:33.900509 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.900331    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 21:45:33.900509 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.900373    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.900509 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.900405    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 21:45:33.900730 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.900650    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 21:45:33.904626 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.904588    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 21:45:33.905310 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.905289    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.905589 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.905573    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sm6md\""
Jul 17 21:45:33.905958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.905941    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.906013 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.905984    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.906660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.906636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.908371 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.908348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cjbwk\""
Jul 17 21:45:33.908630 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.908593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:33.908779 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.908760    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.909000 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.908869    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:33.909000 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.908647    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.909117 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:33.909014    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:33.909174 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909105    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 21:45:33.909400 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909379    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.909505 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909438    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 21:45:33.909564 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909538    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-769p8\""
Jul 17 21:45:33.909564 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909569    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.909775 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.909753    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 21:45:33.910733 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.910714    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:33.910829 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:33.910787    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:33.912161 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912141    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:45:33.912272 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912251    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxs2l\""
Jul 17 21:45:33.912432 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-cni-binary-copy\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.912527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912442    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-hostroot\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.912527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5e6c285-6810-4a59-aa56-a8572a296881-host\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:33.912527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-netd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5e6c285-6810-4a59-aa56-a8572a296881-serviceca\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912583    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.912690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcsxc\" (UniqueName: \"kubernetes.io/projected/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kube-api-access-gcsxc\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-os-release\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-socket-dir-parent\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovn-node-metrics-cert\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnstg\" (UniqueName: \"kubernetes.io/projected/7225ef5f-ef96-4940-8170-e04f34f61010-kube-api-access-mnstg\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9mxb\" (UniqueName: \"kubernetes.io/projected/cdcf168c-2994-484a-a1be-e8f741d78429-kube-api-access-g9mxb\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-etc-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-systemd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912885    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-var-lib-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-config\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqn9\" (UniqueName: \"kubernetes.io/projected/e5e6c285-6810-4a59-aa56-a8572a296881-kube-api-access-mcqn9\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:33.912997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.912980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-log-socket\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913021    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-ovn\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-env-overrides\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45105e01-7ce4-4351-8485-20ea0a18d1f3-hosts-file\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7225ef5f-ef96-4940-8170-e04f34f61010-iptables-alerter-script\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-system-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-k8s-cni-cncf-io\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913228    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-systemd-units\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-bin\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913279    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913337    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-kubelet\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-netns\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-conf-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-device-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.913535 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-kubelet\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-slash\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-script-lib\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913549    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7225ef5f-ef96-4940-8170-e04f34f61010-host-slash\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-kubelet-config\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-dbus\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45105e01-7ce4-4351-8485-20ea0a18d1f3-tmp-dir\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-multus-certs\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q8ms\" (UniqueName: \"kubernetes.io/projected/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-kube-api-access-2q8ms\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913798    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-cnibin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-multus\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-etc-kubernetes\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-netns\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.914233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.913992    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-bin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.915017 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.914005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-multus-daemon-config\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:33.915017 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.914018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zv4b\" (UniqueName: \"kubernetes.io/projected/45105e01-7ce4-4351-8485-20ea0a18d1f3-kube-api-access-7zv4b\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:33.915017 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.914031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:33.915017 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.914046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-node-log\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:33.915017 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.914820    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:33.915299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.915277    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 21:45:33.915299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.915293    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 21:45:33.915414 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.915330    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fd6sd\""
Jul 17 21:45:33.917465 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.917447    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:45:33.917674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.917654    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p6hkn\""
Jul 17 21:45:33.917973 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.917880    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 21:45:33.918075 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.918061    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 21:45:33.937429 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.937377    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gsjd"
Jul 17 21:45:33.944235 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:33.944211    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gsjd"
Jul 17 21:45:34.004055 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.004022    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 21:45:34.007607 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.007551    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal" event={"ID":"9b7594f29e16e38aefd9e13645c1b3bc","Type":"ContainerStarted","Data":"63a1e4ea1c50c032ecf9f332fdddf22d2bf12ee6f0e1f0637dc366d58f481ab8"}
Jul 17 21:45:34.008850 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.008827    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal" event={"ID":"5bbf25cceae141e44dda00b143173f3e","Type":"ContainerStarted","Data":"f9045da75d9986cb6d9e881c6f8886f60a995071b81abe948acbe1e6e64baac1"}
Jul 17 21:45:34.015224 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-hostroot\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.015342 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5e6c285-6810-4a59-aa56-a8572a296881-host\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.015342 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015342 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-netd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015342 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015307    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5e6c285-6810-4a59-aa56-a8572a296881-serviceca\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.015342 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015330    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcsxc\" (UniqueName: \"kubernetes.io/projected/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kube-api-access-gcsxc\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-os-release\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-socket-dir-parent\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovn-node-metrics-cert\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnstg\" (UniqueName: \"kubernetes.io/projected/7225ef5f-ef96-4940-8170-e04f34f61010-kube-api-access-mnstg\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-run\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9mxb\" (UniqueName: \"kubernetes.io/projected/cdcf168c-2994-484a-a1be-e8f741d78429-kube-api-access-g9mxb\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.015551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-etc-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysconfig\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015581    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-systemd\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-lib-modules\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-host\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-tmp\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-systemd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-var-lib-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-config\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqn9\" (UniqueName: \"kubernetes.io/projected/e5e6c285-6810-4a59-aa56-a8572a296881-kube-api-access-mcqn9\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-log-socket\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cnibin\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-os-release\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-ovn\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-env-overrides\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.015982 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.015977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45105e01-7ce4-4351-8485-20ea0a18d1f3-hosts-file\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016031    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7225ef5f-ef96-4940-8170-e04f34f61010-iptables-alerter-script\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749sm\" (UniqueName: \"kubernetes.io/projected/7f468991-8530-453e-b77a-2d6f4abc2ebd-kube-api-access-749sm\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016076    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfth\" (UniqueName: \"kubernetes.io/projected/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-kube-api-access-dpfth\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016091    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-system-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016110    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-k8s-cni-cncf-io\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-systemd-units\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-bin\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-conf\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016200    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-system-cni-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-kubelet\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-kubernetes\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.016802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-netns\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-conf-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-device-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-kubelet\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-slash\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-tuned\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-script-lib\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7225ef5f-ef96-4940-8170-e04f34f61010-host-slash\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-kubelet-config\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016510    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-dbus\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016561    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-sys\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45105e01-7ce4-4351-8485-20ea0a18d1f3-tmp-dir\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-multus-certs\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q8ms\" (UniqueName: \"kubernetes.io/projected/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-kube-api-access-2q8ms\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.017417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7104a909-2950-4f03-ac11-04d10d94d5fa-agent-certs\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-cnibin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016829    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-multus\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-etc-kubernetes\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-netns\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qhhs\" (UniqueName: \"kubernetes.io/projected/0abef86f-92d6-4155-a074-8234053b0fe6-kube-api-access-6qhhs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.016987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7104a909-2950-4f03-ac11-04d10d94d5fa-konnectivity-ca\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017011    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-bin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017028    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-multus-daemon-config\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zv4b\" (UniqueName: \"kubernetes.io/projected/45105e01-7ce4-4351-8485-20ea0a18d1f3-kube-api-access-7zv4b\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017091    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-node-log\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-var-lib-kubelet\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017134    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-cni-binary-copy\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-modprobe-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-hostroot\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5e6c285-6810-4a59-aa56-a8572a296881-host\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-netd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017697    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5e6c285-6810-4a59-aa56-a8572a296881-serviceca\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-log-socket\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-kubelet\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-ovn\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-netns\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017926    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-conf-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-device-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.017996    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018095    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-kubelet\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-slash\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.018527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-socket-dir-parent\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-env-overrides\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018309    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45105e01-7ce4-4351-8485-20ea0a18d1f3-hosts-file\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018413    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-multus-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-script-lib\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7225ef5f-ef96-4940-8170-e04f34f61010-host-slash\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-kubelet-config\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df12f5bb-4ab5-4df2-899e-5b6745e066aa-dbus\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.018967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7225ef5f-ef96-4940-8170-e04f34f61010-iptables-alerter-script\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.019037    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019069    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-system-cni-dir\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.019097    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:45:34.519075144 +0000 UTC m=+2.998027695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019110    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-k8s-cni-cncf-io\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-systemd-units\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.019279 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-cni-bin\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45105e01-7ce4-4351-8485-20ea0a18d1f3-tmp-dir\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-run-multus-certs\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-cnibin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-multus\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-etc-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020031 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.019812    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-etc-kubernetes\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020239 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020036    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.020239 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-node-log\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020315 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-multus-daemon-config\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020414 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-host-var-lib-cni-bin\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020414 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020361    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020414 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020361    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-host-run-netns\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020414 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-var-lib-openvswitch\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020727 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020411    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-run-systemd\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.020727 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdcf168c-2994-484a-a1be-e8f741d78429-os-release\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.020727 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.020513    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdcf168c-2994-484a-a1be-e8f741d78429-cni-binary-copy\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.021258 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.021240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovnkube-config\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.026127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.025917    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-ovn-node-metrics-cert\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.028347 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.028288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnstg\" (UniqueName: \"kubernetes.io/projected/7225ef5f-ef96-4940-8170-e04f34f61010-kube-api-access-mnstg\") pod \"iptables-alerter-htbr4\" (UID: \"7225ef5f-ef96-4940-8170-e04f34f61010\") " pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.029147 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.029125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcsxc\" (UniqueName: \"kubernetes.io/projected/4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd-kube-api-access-gcsxc\") pod \"aws-ebs-csi-driver-node-b9tvn\" (UID: \"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.029229 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.029173    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqn9\" (UniqueName: \"kubernetes.io/projected/e5e6c285-6810-4a59-aa56-a8572a296881-kube-api-access-mcqn9\") pod \"node-ca-q2vxh\" (UID: \"e5e6c285-6810-4a59-aa56-a8572a296881\") " pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.029340 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.029314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9mxb\" (UniqueName: \"kubernetes.io/projected/cdcf168c-2994-484a-a1be-e8f741d78429-kube-api-access-g9mxb\") pod \"multus-xxxx8\" (UID: \"cdcf168c-2994-484a-a1be-e8f741d78429\") " pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.031681 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.031244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q8ms\" (UniqueName: \"kubernetes.io/projected/e039dfa3-903f-4bf1-84c7-b1d6dd609fef-kube-api-access-2q8ms\") pod \"ovnkube-node-7nnm5\" (UID: \"e039dfa3-903f-4bf1-84c7-b1d6dd609fef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.032916 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.032893    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zv4b\" (UniqueName: \"kubernetes.io/projected/45105e01-7ce4-4351-8485-20ea0a18d1f3-kube-api-access-7zv4b\") pod \"node-resolver-hkgbn\" (UID: \"45105e01-7ce4-4351-8485-20ea0a18d1f3\") " pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.117804 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-run\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.117804 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysconfig\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysconfig\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-run\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-systemd\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117954    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-lib-modules\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-host\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-tmp\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.117955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-systemd\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cnibin\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-os-release\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-host\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-749sm\" (UniqueName: \"kubernetes.io/projected/7f468991-8530-453e-b77a-2d6f4abc2ebd-kube-api-access-749sm\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfth\" (UniqueName: \"kubernetes.io/projected/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-kube-api-access-dpfth\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118179    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-lib-modules\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-os-release\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-conf\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cnibin\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-conf\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118389 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-system-cni-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-kubernetes\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-tuned\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-sys\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-sysctl-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7104a909-2950-4f03-ac11-04d10d94d5fa-agent-certs\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118697    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-system-cni-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qhhs\" (UniqueName: \"kubernetes.io/projected/0abef86f-92d6-4155-a074-8234053b0fe6-kube-api-access-6qhhs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118756    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7104a909-2950-4f03-ac11-04d10d94d5fa-konnectivity-ca\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118767    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-kubernetes\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-var-lib-kubelet\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.118986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-modprobe-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-modprobe-d\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.118994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-var-lib-kubelet\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.119027    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.119092    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:45:34.619071594 +0000 UTC m=+3.098024152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.119246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7104a909-2950-4f03-ac11-04d10d94d5fa-konnectivity-ca\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.119290    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.119320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f468991-8530-453e-b77a-2d6f4abc2ebd-sys\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.119871 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.119568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.121169 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.121144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-tmp\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.121288 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.121230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f468991-8530-453e-b77a-2d6f4abc2ebd-etc-tuned\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.123169 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.123149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7104a909-2950-4f03-ac11-04d10d94d5fa-agent-certs\") pod \"konnectivity-agent-8gnd2\" (UID: \"7104a909-2950-4f03-ac11-04d10d94d5fa\") " pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.128119 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.128098    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:34.128119 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.128121    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:34.128261 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.128134    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:34.128261 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.128203    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:45:34.62818624 +0000 UTC m=+3.107138778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:34.129888 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.129838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-749sm\" (UniqueName: \"kubernetes.io/projected/7f468991-8530-453e-b77a-2d6f4abc2ebd-kube-api-access-749sm\") pod \"tuned-wqnws\" (UID: \"7f468991-8530-453e-b77a-2d6f4abc2ebd\") " pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.130815 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.130786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qhhs\" (UniqueName: \"kubernetes.io/projected/0abef86f-92d6-4155-a074-8234053b0fe6-kube-api-access-6qhhs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.131334 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.131304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfth\" (UniqueName: \"kubernetes.io/projected/9c96e3ab-1a01-462f-8e8f-2a3c660449a5-kube-api-access-dpfth\") pod \"multus-additional-cni-plugins-sh5j2\" (UID: \"9c96e3ab-1a01-462f-8e8f-2a3c660449a5\") " pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.213869 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.213785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2vxh"
Jul 17 21:45:34.222793 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.222642    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htbr4"
Jul 17 21:45:34.232505 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.232337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:45:34.237227 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.237203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hkgbn"
Jul 17 21:45:34.247053 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.247030    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xxxx8"
Jul 17 21:45:34.253599 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.253576    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn"
Jul 17 21:45:34.258555 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.258506    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:45:34.262587 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.262563    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqnws"
Jul 17 21:45:34.269683 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.269662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sh5j2"
Jul 17 21:45:34.276092 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.276071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:34.522232 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.522152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:34.522393 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.522324    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:34.522454 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.522414    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:45:35.522376914 +0000 UTC m=+4.001329452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:34.622851 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.622822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:34.622990 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.622959    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:34.623043 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.623038    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:45:35.623022372 +0000 UTC m=+4.101974909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:34.723841 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.723808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:34.724010 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.723946    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:34.724010 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.723965    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:34.724010 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.723978    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:34.724136 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:34.724028    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:45:35.724010363 +0000 UTC m=+4.202962898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:34.947202 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.947145    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 21:40:33 +0000 UTC" deadline="2028-03-11 04:14:05.459053357 +0000 UTC"
Jul 17 21:45:34.947202 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:34.947201    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14454h28m30.511860684s"
Jul 17 21:45:35.002631 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.002582    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:35.002820 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.002724    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:35.256135 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:35.256109    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e6c285_6810_4a59_aa56_a8572a296881.slice/crio-07199605a763ed43c75db56485641bd2752f1b8ed58a12b15ff06e852c67bcb4 WatchSource:0}: Error finding container 07199605a763ed43c75db56485641bd2752f1b8ed58a12b15ff06e852c67bcb4: Status 404 returned error can't find the container with id 07199605a763ed43c75db56485641bd2752f1b8ed58a12b15ff06e852c67bcb4
Jul 17 21:45:35.267395 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:45:35.267370    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45105e01_7ce4_4351_8485_20ea0a18d1f3.slice/crio-bb1eae60434a81ffbee707d58db4b067d876fec2496572fbb5907daff4dce7da WatchSource:0}: Error finding container bb1eae60434a81ffbee707d58db4b067d876fec2496572fbb5907daff4dce7da: Status 404 returned error can't find the container with id bb1eae60434a81ffbee707d58db4b067d876fec2496572fbb5907daff4dce7da
Jul 17 21:45:35.531737 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.531516    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:35.531877 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.531687    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:35.531877 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.531843    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:45:37.531828421 +0000 UTC m=+6.010780955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:35.632879 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.632845    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:35.633034 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.632978    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:35.633034 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.633030    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:45:37.633018016 +0000 UTC m=+6.111970550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:35.733269 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.733229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:35.733477 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.733456    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:35.733536 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.733483    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:35.733536 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.733493    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:35.733598 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:35.733549    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:45:37.733531812 +0000 UTC m=+6.212484370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:35.948084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.948017    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 21:40:33 +0000 UTC" deadline="2027-12-12 14:48:43.373593245 +0000 UTC"
Jul 17 21:45:35.948084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:35.948080    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12305h3m7.425517239s"
Jul 17 21:45:36.005651 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.004936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:36.005651 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:36.005066    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:36.005651 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.005465    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:36.005651 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:36.005575    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:36.021423 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.021328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqnws" event={"ID":"7f468991-8530-453e-b77a-2d6f4abc2ebd","Type":"ContainerStarted","Data":"d273934790ec81a6576e0f8c018ed8cf7c5da54b14c9464377df0d188116d796"}
Jul 17 21:45:36.023173 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.023027    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htbr4" event={"ID":"7225ef5f-ef96-4940-8170-e04f34f61010","Type":"ContainerStarted","Data":"f762cb88fcfede42d10bb6747d955e95ae6d2b3d79dafe484b80c3c87f1c0cd2"}
Jul 17 21:45:36.025836 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.025781    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn" event={"ID":"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd","Type":"ContainerStarted","Data":"ce4bb2bf07c0c9ea5f609776d61e4d16da2304d6941731f9affd0cddaf929dfc"}
Jul 17 21:45:36.028205 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.028147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hkgbn" event={"ID":"45105e01-7ce4-4351-8485-20ea0a18d1f3","Type":"ContainerStarted","Data":"bb1eae60434a81ffbee707d58db4b067d876fec2496572fbb5907daff4dce7da"}
Jul 17 21:45:36.033228 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.033171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxxx8" event={"ID":"cdcf168c-2994-484a-a1be-e8f741d78429","Type":"ContainerStarted","Data":"cb55c444cfa0a334dc5f31f6344db8865a380afe5c8a1ed73d8752eb43971e25"}
Jul 17 21:45:36.034795 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.034733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gnd2" event={"ID":"7104a909-2950-4f03-ac11-04d10d94d5fa","Type":"ContainerStarted","Data":"d902760848357ad17ceaacb780b7be6ddbed1dd83f06261d811f3bb178949272"}
Jul 17 21:45:36.036900 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.036847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2vxh" event={"ID":"e5e6c285-6810-4a59-aa56-a8572a296881","Type":"ContainerStarted","Data":"07199605a763ed43c75db56485641bd2752f1b8ed58a12b15ff06e852c67bcb4"}
Jul 17 21:45:36.044816 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.044747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal" event={"ID":"9b7594f29e16e38aefd9e13645c1b3bc","Type":"ContainerStarted","Data":"0fa89eff88d429a86119328712be90b97397465a09ea6139613488fbb69b0e93"}
Jul 17 21:45:36.048417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.047089    2570 generic.go:356] "Generic (PLEG): container finished" podID="5bbf25cceae141e44dda00b143173f3e" containerID="489be9176e2368c4564c0c9dc9ce5ad6d7e572b053dda467c3e3712876d45875" exitCode=0
Jul 17 21:45:36.048417 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.047161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal" event={"ID":"5bbf25cceae141e44dda00b143173f3e","Type":"ContainerDied","Data":"489be9176e2368c4564c0c9dc9ce5ad6d7e572b053dda467c3e3712876d45875"}
Jul 17 21:45:36.049974 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.049894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerStarted","Data":"23f2b080e37fe62f9ec9af121ebb1025036de8b475c69f3905b75a011434a096"}
Jul 17 21:45:36.052870 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.052715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"ffd25945ca912c2cb64524de0133ff0e4cb9fe6f32c0679ce30481cff648d339"}
Jul 17 21:45:36.060933 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:36.060050    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-4.ec2.internal" podStartSLOduration=3.060031805 podStartE2EDuration="3.060031805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:36.059263728 +0000 UTC m=+4.538216311" watchObservedRunningTime="2026-07-17 21:45:36.060031805 +0000 UTC m=+4.538984362"
Jul 17 21:45:37.002634 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:37.002579    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:37.003098 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.002729    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:37.069757 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:37.069661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal" event={"ID":"5bbf25cceae141e44dda00b143173f3e","Type":"ContainerStarted","Data":"e045452fd62c4fa89b0442a4a20911320769158578ae115724b6c079fb24cfc0"}
Jul 17 21:45:37.549525 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:37.548947    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:37.549525 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.549119    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:37.549525 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.549175    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:45:41.54915841 +0000 UTC m=+10.028110947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:37.649732 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:37.649698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:37.649916 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.649854    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:37.649916 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.649911    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:45:41.649891812 +0000 UTC m=+10.128844350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:37.750636 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:37.750583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:37.750801 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.750777    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:37.750801 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.750799    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:37.750919 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.750813    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:37.750919 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:37.750870    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:45:41.75085234 +0000 UTC m=+10.229804890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:38.004858 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:38.004768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:38.005318 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:38.004905    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:38.005318 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:38.005102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:38.005318 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:38.005202    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:39.003225 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:39.002747    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:39.003225 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:39.002885    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:40.002847 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:40.002810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:40.005846 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:40.005436    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:40.005846 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:40.005665    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:40.005846 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:40.005773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:41.003260 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:41.003173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:41.003736 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.003311    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:41.585341 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:41.585298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:41.585573 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.585465    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:41.585573 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.585542    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:45:49.585520219 +0000 UTC m=+18.064472768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:41.686140 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:41.686107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:41.686356 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.686250    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:41.686356 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.686314    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:45:49.686294023 +0000 UTC m=+18.165246557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:41.787216 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:41.787132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:41.787369 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.787339    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:41.787369 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.787369    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:41.787447 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.787382    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:41.787513 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:41.787447    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:45:49.787429276 +0000 UTC m=+18.266381813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:42.003476 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:42.003392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:42.003954 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:42.003477    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:42.003954 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:42.003884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:42.004071 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:42.003984    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:43.002625 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:43.002591    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:43.002820 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:43.002734    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:44.005051 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:44.005017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:44.005454 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:44.005111    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:44.005454 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:44.005409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:44.005526 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:44.005479    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:45.003844 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:45.003220    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:45.003844 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:45.003322    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:46.002549 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:46.002521    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:46.002975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:46.002638    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:46.002975 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:46.002643    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:46.002975 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:46.002737    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:47.003044 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:47.003000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:47.003413 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:47.003124    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:48.002734 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:48.002699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:48.002919 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:48.002700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:48.002919 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:48.002876    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:48.002919 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:48.002911    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:49.003175 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:49.003141    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:49.003713 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.003268    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:49.652134 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:49.652090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:49.652327 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.652280    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:49.652386 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.652348    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:46:05.652331799 +0000 UTC m=+34.131284333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:45:49.752779 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:49.752755    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:49.752910 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.752893    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:49.752961 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.752952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:05.752937626 +0000 UTC m=+34.231890160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:45:49.853881 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:49.853842    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:49.854061 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.854036    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:45:49.854118 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.854065    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:45:49.854118 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.854078    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:49.854210 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:49.854149    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:46:05.854128952 +0000 UTC m=+34.333081510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:45:50.003176 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:50.003144    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:50.003635 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:50.003244    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:50.003635 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:50.003297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:50.003635 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:50.003390    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:51.003306 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:51.003270    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:51.003785 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:51.003391    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:52.003588 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:52.003548    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:52.004071 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:52.003694    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:52.004071 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:52.003750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:52.004071 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:52.003847    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:53.003051 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:53.003006    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:53.003241 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:53.003116    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:54.002516 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:54.002475    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:54.002516 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:54.002512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:54.003159 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:54.002632    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:54.003159 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:54.002736    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:55.003421 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.002977    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:55.003946 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:55.003547    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:55.112089 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.112056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn" event={"ID":"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd","Type":"ContainerStarted","Data":"4d1dff2c762c8301a5ae9d756d21b7be6c7f467180a84f86552645cf7911937b"}
Jul 17 21:45:55.113293 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.113269    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hkgbn" event={"ID":"45105e01-7ce4-4351-8485-20ea0a18d1f3","Type":"ContainerStarted","Data":"8e33917301a3150e8f1608aa7fda19ac156bc992016bb1c6d93ef73941e073f0"}
Jul 17 21:45:55.114692 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.114671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xxxx8" event={"ID":"cdcf168c-2994-484a-a1be-e8f741d78429","Type":"ContainerStarted","Data":"a85e84d184266a753b1e9b7692edb47e3810f2a24469a77d81e0bb0b889519f9"}
Jul 17 21:45:55.115940 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.115916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gnd2" event={"ID":"7104a909-2950-4f03-ac11-04d10d94d5fa","Type":"ContainerStarted","Data":"6b346bc24cf7ce7006b70e35ffd0fd62fb93759f802c2a228e118708c611f81d"}
Jul 17 21:45:55.117166 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.117148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2vxh" event={"ID":"e5e6c285-6810-4a59-aa56-a8572a296881","Type":"ContainerStarted","Data":"ce2d39ea338d4b8d071ddd9a1e0b7476544d26ec36225e68611c157852a34126"}
Jul 17 21:45:55.118463 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.118440    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="e6af5c29adfbf592709aa9b92b28863860d0a33e0d7f8b9b62dbcfb55479bbe7" exitCode=0
Jul 17 21:45:55.118549 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.118515    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"e6af5c29adfbf592709aa9b92b28863860d0a33e0d7f8b9b62dbcfb55479bbe7"}
Jul 17 21:45:55.121675 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"8285bc96a3392074b02116c295c41a4a09c69780a0991fd5ab4a94d609a63908"}
Jul 17 21:45:55.121757 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121720    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"e78c306bfee78d7ea8f797534c2043f21909865c0bc8506768bd41633405bc9a"}
Jul 17 21:45:55.121757 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121754    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"4ff7029b1229f59fa7d65227e0dffa999db95c102433493ece0a1ff1baf9b7fd"}
Jul 17 21:45:55.121858 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"3e36f52e14792ac41ece17192183adebd0d9c1264890fa48b6f9cde9127c852e"}
Jul 17 21:45:55.121858 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"f28cb98bbca5d067673b4c508d4c0dd050d9cfc97ba3593ceeb695c785cea646"}
Jul 17 21:45:55.121858 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.121856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"c1f03df535105328d6bd3146b7e92b819cb850074ee56d91215660c5e9bac03b"}
Jul 17 21:45:55.122952 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.122934    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqnws" event={"ID":"7f468991-8530-453e-b77a-2d6f4abc2ebd","Type":"ContainerStarted","Data":"e2663f9837c9e2c08ef7bdf5a2edda5b39159f70d3c62102843196fb801a0552"}
Jul 17 21:45:55.138036 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.137994    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-4.ec2.internal" podStartSLOduration=22.137981697 podStartE2EDuration="22.137981697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:37.086026106 +0000 UTC m=+5.564978665" watchObservedRunningTime="2026-07-17 21:45:55.137981697 +0000 UTC m=+23.616934253"
Jul 17 21:45:55.160655 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.160578    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hkgbn" podStartSLOduration=4.150506479 podStartE2EDuration="23.160560936s" totalImagesPullingTime="19.010054457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:55.138242297 +0000 UTC m=+23.617194852" watchObservedRunningTime="2026-07-17 21:45:55.160560936 +0000 UTC m=+23.639513483"
Jul 17 21:45:55.174209 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.174156    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q2vxh" podStartSLOduration=4.161044338 podStartE2EDuration="23.174144163s" totalImagesPullingTime="19.013099825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:55.173882075 +0000 UTC m=+23.652834631" watchObservedRunningTime="2026-07-17 21:45:55.174144163 +0000 UTC m=+23.653096719"
Jul 17 21:45:55.190386 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.190347    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xxxx8" podStartSLOduration=4.135680534 podStartE2EDuration="23.190334017s" totalImagesPullingTime="19.054653483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:55.189511531 +0000 UTC m=+23.668464087" watchObservedRunningTime="2026-07-17 21:45:55.190334017 +0000 UTC m=+23.669286573"
Jul 17 21:45:55.209200 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.209155    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wqnws" podStartSLOduration=4.188772763 podStartE2EDuration="23.209142642s" totalImagesPullingTime="19.020369879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:55.209075984 +0000 UTC m=+23.688028540" watchObservedRunningTime="2026-07-17 21:45:55.209142642 +0000 UTC m=+23.688095197"
Jul 17 21:45:55.228744 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:55.228704    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8gnd2" podStartSLOduration=8.761370034 podStartE2EDuration="23.22869276s" totalImagesPullingTime="14.467322726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:55.2283032 +0000 UTC m=+23.707255755" watchObservedRunningTime="2026-07-17 21:45:55.22869276 +0000 UTC m=+23.707645315"
Jul 17 21:45:56.003320 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.003236    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:56.003320 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.003285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:56.003818 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:56.003368    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:56.003818 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:56.003475    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:56.125891 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.125854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htbr4" event={"ID":"7225ef5f-ef96-4940-8170-e04f34f61010","Type":"ContainerStarted","Data":"5a6d26d348fb27d730473d29ffe4a5d73b648c5b5931a715469eaa2bd04807db"}
Jul 17 21:45:56.141480 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.141435    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-htbr4" podStartSLOduration=9.674197476 podStartE2EDuration="24.141419588s" totalImagesPullingTime="14.467222112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:56.14122029 +0000 UTC m=+24.620172846" watchObservedRunningTime="2026-07-17 21:45:56.141419588 +0000 UTC m=+24.620372143"
Jul 17 21:45:56.325966 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.325942    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 21:45:56.964387 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.964271    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T21:45:56.32596056Z","UUID":"f5ebfb17-3acf-48f1-985b-f7cc3a279c3a","Handler":null,"Name":"","Endpoint":""}
Jul 17 21:45:56.965944 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.965922    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 21:45:56.966058 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:56.965959    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 21:45:57.002399 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:57.002372    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:57.002569 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:57.002500    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:57.130893 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:57.130864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn" event={"ID":"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd","Type":"ContainerStarted","Data":"6755b4110a604c93737ab0e0d6b19b5a54a11b14d3335a0e16fc95075e541ad0"}
Jul 17 21:45:58.003662 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:58.003428    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:45:58.003875 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:58.003438    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:45:58.003875 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:58.003769    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:45:58.003875 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:58.003837    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:45:58.138130 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:58.138093    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"d56a5a3bddbe6aa22840ab030e05a9670b18cec89ffd4faeb4d3a10d4d7ba247"}
Jul 17 21:45:58.141672 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:58.141644    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn" event={"ID":"4eb0855a-f28e-454c-aa3e-4b5f2cbee7fd","Type":"ContainerStarted","Data":"63ed7dc8215ccdc28314bccd7eeadc5a3c2255692d03ff10de32969d4a4259e1"}
Jul 17 21:45:58.158603 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:58.158555    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9tvn" podStartSLOduration=4.020387239 podStartE2EDuration="26.158537716s" totalImagesPullingTime="22.138150477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:58.158431842 +0000 UTC m=+26.637384400" watchObservedRunningTime="2026-07-17 21:45:58.158537716 +0000 UTC m=+26.637490272"
Jul 17 21:45:59.002547 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:59.002507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:45:59.002743 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:45:59.002633    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:45:59.275866 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:59.275842    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:45:59.276526 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:45:59.276401    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:46:00.003039 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.002806    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:00.003224 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:00.003146    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:46:00.003532 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.002872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:00.003691 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:00.003658    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:46:00.150313 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.150264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" event={"ID":"e039dfa3-903f-4bf1-84c7-b1d6dd609fef","Type":"ContainerStarted","Data":"3925da7212a46ec3c84817d6cfa11b8457d29e4bb5e499d6f828e08417015bc9"}
Jul 17 21:46:00.150631 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.150586    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:46:00.151060 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.151043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8gnd2"
Jul 17 21:46:00.175634 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:00.175563    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5" podStartSLOduration=9.096749617 podStartE2EDuration="28.175543984s" totalImagesPullingTime="19.078794367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:00.175261396 +0000 UTC m=+28.654213954" watchObservedRunningTime="2026-07-17 21:46:00.175543984 +0000 UTC m=+28.654496541"
Jul 17 21:46:01.003162 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.003130    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:01.003675 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:01.003266    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:46:01.153952 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.153915    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:01.154150 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.154002    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:01.154150 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.154035    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:01.173865 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.173831    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:01.174522 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.174501    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:01.571717 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.571687    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnn57"]
Jul 17 21:46:01.571881 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.571814    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:01.571953 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:01.571917    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:46:01.574802 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.574773    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tllgr"]
Jul 17 21:46:01.574953 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.574891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:01.575008 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:01.574988    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:46:01.575412 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.575392    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vh2zh"]
Jul 17 21:46:01.575503 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:01.575480    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:01.575583 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:01.575567    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:46:02.157035 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:02.156937    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="9095ad04d2209d4904ee1e509db7e45f98cfd07144598b59d780a557bad8fc22" exitCode=0
Jul 17 21:46:02.157651 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:02.157029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"9095ad04d2209d4904ee1e509db7e45f98cfd07144598b59d780a557bad8fc22"}
Jul 17 21:46:03.003299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:03.003107    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:03.003450 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:03.003105    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:03.003450 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:03.003401    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:46:03.003542 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:03.003134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:03.003542 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:03.003445    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:46:03.003636 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:03.003546    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:46:03.161136 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:03.161107    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="0ef1dfe4265aa1d69e7f97da21951016e39b110b118f5e2f575441c3162fda46" exitCode=0
Jul 17 21:46:03.161641 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:03.161202    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"0ef1dfe4265aa1d69e7f97da21951016e39b110b118f5e2f575441c3162fda46"}
Jul 17 21:46:04.165363 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:04.165327    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="0e3f063d0a7364e4702c7beb788cd593b37c5cddbfd6fe01366e22e85243a5b0" exitCode=0
Jul 17 21:46:04.165901 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:04.165394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"0e3f063d0a7364e4702c7beb788cd593b37c5cddbfd6fe01366e22e85243a5b0"}
Jul 17 21:46:05.003269 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.003234    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:05.003450 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.003282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:05.003450 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.003328    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:05.003450 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.003340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:46:05.003450 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.003416    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:46:05.003604 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.003486    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:46:05.670037 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.670003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:05.670508 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.670169    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:46:05.670508 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.670234    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret podName:df12f5bb-4ab5-4df2-899e-5b6745e066aa nodeName:}" failed. No retries permitted until 2026-07-17 21:46:37.67021692 +0000 UTC m=+66.149169453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret") pod "global-pull-secret-syncer-rnn57" (UID: "df12f5bb-4ab5-4df2-899e-5b6745e066aa") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:46:05.771129 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.771094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:05.771280 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.771205    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:46:05.771280 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.771272    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs podName:0abef86f-92d6-4155-a074-8234053b0fe6 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:37.771256129 +0000 UTC m=+66.250208667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs") pod "network-metrics-daemon-vh2zh" (UID: "0abef86f-92d6-4155-a074-8234053b0fe6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:46:05.872009 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:05.871967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:05.872174 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.872156    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:46:05.872174 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.872174    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:46:05.872290 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.872186    2570 projected.go:196] Error preparing data for projected volume kube-api-access-vqf98 for pod openshift-network-diagnostics/network-check-target-tllgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:46:05.872290 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:05.872247    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98 podName:26bac29c-ec3d-4432-8e60-3a7e39a36eeb nodeName:}" failed. No retries permitted until 2026-07-17 21:46:37.87222964 +0000 UTC m=+66.351182179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqf98" (UniqueName: "kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98") pod "network-check-target-tllgr" (UID: "26bac29c-ec3d-4432-8e60-3a7e39a36eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:46:07.002465 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:07.002430    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:07.003024 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:07.002509    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:07.003024 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:07.002609    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:07.003024 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:07.002630    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnn57" podUID="df12f5bb-4ab5-4df2-899e-5b6745e066aa"
Jul 17 21:46:07.003024 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:07.002720    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vh2zh" podUID="0abef86f-92d6-4155-a074-8234053b0fe6"
Jul 17 21:46:07.003024 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:07.002805    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tllgr" podUID="26bac29c-ec3d-4432-8e60-3a7e39a36eeb"
Jul 17 21:46:08.393554 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.393521    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-4.ec2.internal" event="NodeReady"
Jul 17 21:46:08.393985 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.393688    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 21:46:08.426482 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.426445    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v6kxc"]
Jul 17 21:46:08.444608 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.444573    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"]
Jul 17 21:46:08.444779 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.444727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.448739 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.448711    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cjw75\""
Jul 17 21:46:08.448864 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.448772    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.448864 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.448814    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.449039 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.449017    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 21:46:08.449117 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.449016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 21:46:08.455368 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.455306    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:46:08.456303 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.456238    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 21:46:08.456668 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.456473    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.459898 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.459880    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.460880 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.460857    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 21:46:08.463671 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.463599    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.464018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.463994    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r662j\""
Jul 17 21:46:08.464440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.464418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 21:46:08.470240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.470219    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-95685859b-f5ml8"]
Jul 17 21:46:08.470343 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.470326    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.478814 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.472956    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6j6px\""
Jul 17 21:46:08.478814 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.473060    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 21:46:08.478814 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.473769    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 21:46:08.478814 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.474455    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 21:46:08.482699 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.482677    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 21:46:08.483813 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.483789    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"]
Jul 17 21:46:08.484955 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.484934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.487177 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487155    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 21:46:08.487393 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487365    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 21:46:08.487476 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487369    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 21:46:08.487721 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487700    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gc6z4\""
Jul 17 21:46:08.487819 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487722    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 21:46:08.487819 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487729    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.487819 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.487767    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.497158 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.497137    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"]
Jul 17 21:46:08.497296 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.497277    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.499480 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.499455    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 21:46:08.499640 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.499597    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.499716 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.499675    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7cxtk\""
Jul 17 21:46:08.500160 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.500142    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.507016 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.506997    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tkj7z"]
Jul 17 21:46:08.507115 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.507101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"
Jul 17 21:46:08.509501 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.509483    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s5nzn\""
Jul 17 21:46:08.509594 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.509489    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.509594 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.509516    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.522585 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.522559    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"]
Jul 17 21:46:08.522723 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.522692    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.525020 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.524949    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.525020 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.524966    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 21:46:08.525020 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.525008    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 21:46:08.525260 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.525239    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t25th\""
Jul 17 21:46:08.525491 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.525469    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.531476 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.531456    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 21:46:08.532926 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.532906    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"]
Jul 17 21:46:08.533046 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.533031    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.535543 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.535522    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.535661 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.535545    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rjj2h\""
Jul 17 21:46:08.535813 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.535795    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.535918 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.535899    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 21:46:08.535997 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.535981    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 21:46:08.543890 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543871    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v6kxc"]
Jul 17 21:46:08.543989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543906    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"]
Jul 17 21:46:08.543989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543928    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"]
Jul 17 21:46:08.543989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543946    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"]
Jul 17 21:46:08.543989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543961    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"]
Jul 17 21:46:08.543989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543983    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:46:08.544148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543997    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8mj8j"]
Jul 17 21:46:08.544148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.543999    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.547057 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.547038    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 21:46:08.547135 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.547059    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.547135 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.547046    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.547247 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.547231    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 21:46:08.547330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.547316    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9mjqs\""
Jul 17 21:46:08.561098 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.561074    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-95685859b-f5ml8"]
Jul 17 21:46:08.561212 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.561121    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nmwqb"]
Jul 17 21:46:08.561212 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.561204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.564215 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.564189    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 21:46:08.564956 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.564926    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q82nm\""
Jul 17 21:46:08.565070 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.565045    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 21:46:08.576382 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.576362    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"]
Jul 17 21:46:08.576502 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.576484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.578885 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.578843    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.579002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.578933    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.579067 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.579042    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l5qwj\""
Jul 17 21:46:08.579123 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.579110    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 21:46:08.588959 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.588940    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"]
Jul 17 21:46:08.589065 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.588979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tkj7z"]
Jul 17 21:46:08.589065 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.589007    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmwqb"]
Jul 17 21:46:08.589065 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.589026    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8mj8j"]
Jul 17 21:46:08.589065 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.589047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"]
Jul 17 21:46:08.589264 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.589086    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51e1534b-5606-4852-b4bc-4248d1d138f7-serving-cert\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8ba9e578-8318-4518-8595-e2c8fe36dac0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5w94\" (UniqueName: \"kubernetes.io/projected/51e1534b-5606-4852-b4bc-4248d1d138f7-kube-api-access-f5w94\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.590628 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zznv\" (UniqueName: \"kubernetes.io/projected/8ba9e578-8318-4518-8595-e2c8fe36dac0-kube-api-access-9zznv\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-snapshots\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-service-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-stats-auth\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590798    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wv5j\" (UniqueName: \"kubernetes.io/projected/c08e3bea-5c32-4aac-9397-04375fc890ca-kube-api-access-7wv5j\") pod \"volume-data-source-validator-78cf4c6f6-4c5lw\" (UID: \"c08e3bea-5c32-4aac-9397-04375fc890ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590876    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hznt\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-default-certificate\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.590963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dpf\" (UniqueName: \"kubernetes.io/projected/a8fc246d-f514-45ec-9223-abdbad7d5e2e-kube-api-access-z9dpf\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.591003    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.591137 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.591075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-tmp\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.591953 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.591100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8f4\" (UniqueName: \"kubernetes.io/projected/04d1086c-95a3-480d-bf97-637d78ab3117-kube-api-access-ct8f4\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.591953 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.591779    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 21:46:08.592066 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.592054    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 21:46:08.592478 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.592460    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pr8ws\""
Jul 17 21:46:08.692503 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51e1534b-5606-4852-b4bc-4248d1d138f7-serving-cert\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.692503 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.692503 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8ba9e578-8318-4518-8595-e2c8fe36dac0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w94\" (UniqueName: \"kubernetes.io/projected/51e1534b-5606-4852-b4bc-4248d1d138f7-kube-api-access-f5w94\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zznv\" (UniqueName: \"kubernetes.io/projected/8ba9e578-8318-4518-8595-e2c8fe36dac0-kube-api-access-9zznv\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-config-volume\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hznt\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692724    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3b6db22-9111-4be1-914a-d9b20fe23666-cert\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-service-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-stats-auth\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfsml\" (UniqueName: \"kubernetes.io/projected/436f3e3a-f406-49c2-8a98-b6911e709b24-kube-api-access-cfsml\") pod \"network-check-source-7bc5b6bf85-fjjct\" (UID: \"436f3e3a-f406-49c2-8a98-b6911e709b24\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"
Jul 17 21:46:08.692785 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnxpk\" (UniqueName: \"kubernetes.io/projected/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-kube-api-access-lnxpk\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-tmp-dir\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9bm6\" (UniqueName: \"kubernetes.io/projected/26c90da4-e4d1-420a-88ab-4fb8b73da803-kube-api-access-v9bm6\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dpf\" (UniqueName: \"kubernetes.io/projected/a8fc246d-f514-45ec-9223-abdbad7d5e2e-kube-api-access-z9dpf\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-default-certificate\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-trusted-ca\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.692967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1616a665-1311-4a3f-a1e4-7289ffbc3994-config\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-tmp\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rvj\" (UniqueName: \"kubernetes.io/projected/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-kube-api-access-x2rvj\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c90da4-e4d1-420a-88ab-4fb8b73da803-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n997j\" (UniqueName: \"kubernetes.io/projected/d3b6db22-9111-4be1-914a-d9b20fe23666-kube-api-access-n997j\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.693240 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-config\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693208    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1616a665-1311-4a3f-a1e4-7289ffbc3994-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wv5j\" (UniqueName: \"kubernetes.io/projected/c08e3bea-5c32-4aac-9397-04375fc890ca-kube-api-access-7wv5j\") pod \"volume-data-source-validator-78cf4c6f6-4c5lw\" (UID: \"c08e3bea-5c32-4aac-9397-04375fc890ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-snapshots\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhncg\" (UniqueName: \"kubernetes.io/projected/1616a665-1311-4a3f-a1e4-7289ffbc3994-kube-api-access-zhncg\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-serving-cert\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8f4\" (UniqueName: \"kubernetes.io/projected/04d1086c-95a3-480d-bf97-637d78ab3117-kube-api-access-ct8f4\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c90da4-e4d1-420a-88ab-4fb8b73da803-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8ba9e578-8318-4518-8595-e2c8fe36dac0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.693851    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:08.694019 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.693899    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.193882609 +0000 UTC m=+37.672835156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.693903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.694188    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-service-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694240    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.194225239 +0000 UTC m=+37.673177806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694303    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694321    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694372    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.194359794 +0000 UTC m=+37.673312331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.694663    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-tmp\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694741    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.694743    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.694776 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.694784    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.194768732 +0000 UTC m=+37.673721279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:08.695443 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.694841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.695443 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.695013    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/51e1534b-5606-4852-b4bc-4248d1d138f7-snapshots\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.695660 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.695277    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:08.695738 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.695692    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.195674474 +0000 UTC m=+37.674627010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:08.695738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.695726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e1534b-5606-4852-b4bc-4248d1d138f7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.697977 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.697953    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51e1534b-5606-4852-b4bc-4248d1d138f7-serving-cert\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.698090 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.697985    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-stats-auth\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.698090 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.698034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.698090 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.698045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-default-certificate\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.701048 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.700114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.702422 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.702392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.703043 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.702991    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5w94\" (UniqueName: \"kubernetes.io/projected/51e1534b-5606-4852-b4bc-4248d1d138f7-kube-api-access-f5w94\") pod \"insights-operator-555d9d7885-v6kxc\" (UID: \"51e1534b-5606-4852-b4bc-4248d1d138f7\") " pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.703767 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.703728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hznt\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:08.703866 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.703828    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dpf\" (UniqueName: \"kubernetes.io/projected/a8fc246d-f514-45ec-9223-abdbad7d5e2e-kube-api-access-z9dpf\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:08.704061 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.704037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8f4\" (UniqueName: \"kubernetes.io/projected/04d1086c-95a3-480d-bf97-637d78ab3117-kube-api-access-ct8f4\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:08.704906 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.704876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zznv\" (UniqueName: \"kubernetes.io/projected/8ba9e578-8318-4518-8595-e2c8fe36dac0-kube-api-access-9zznv\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:08.705419 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.705310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wv5j\" (UniqueName: \"kubernetes.io/projected/c08e3bea-5c32-4aac-9397-04375fc890ca-kube-api-access-7wv5j\") pod \"volume-data-source-validator-78cf4c6f6-4c5lw\" (UID: \"c08e3bea-5c32-4aac-9397-04375fc890ca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"
Jul 17 21:46:08.761173 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.761142    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v6kxc"
Jul 17 21:46:08.794136 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhncg\" (UniqueName: \"kubernetes.io/projected/1616a665-1311-4a3f-a1e4-7289ffbc3994-kube-api-access-zhncg\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.794247 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-serving-cert\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.794247 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c90da4-e4d1-420a-88ab-4fb8b73da803-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.794247 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.794247 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-config-volume\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3b6db22-9111-4be1-914a-d9b20fe23666-cert\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfsml\" (UniqueName: \"kubernetes.io/projected/436f3e3a-f406-49c2-8a98-b6911e709b24-kube-api-access-cfsml\") pod \"network-check-source-7bc5b6bf85-fjjct\" (UID: \"436f3e3a-f406-49c2-8a98-b6911e709b24\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnxpk\" (UniqueName: \"kubernetes.io/projected/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-kube-api-access-lnxpk\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-tmp-dir\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9bm6\" (UniqueName: \"kubernetes.io/projected/26c90da4-e4d1-420a-88ab-4fb8b73da803-kube-api-access-v9bm6\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-trusted-ca\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.794398    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:08.794440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1616a665-1311-4a3f-a1e4-7289ffbc3994-config\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794474    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rvj\" (UniqueName: \"kubernetes.io/projected/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-kube-api-access-x2rvj\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c90da4-e4d1-420a-88ab-4fb8b73da803-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n997j\" (UniqueName: \"kubernetes.io/projected/d3b6db22-9111-4be1-914a-d9b20fe23666-kube-api-access-n997j\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-config\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1616a665-1311-4a3f-a1e4-7289ffbc3994-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.795002 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.794872    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-config-volume\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.795269 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.795038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-tmp-dir\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.795605 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.795585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c90da4-e4d1-420a-88ab-4fb8b73da803-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.795808 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.795787    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-config\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.795878 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:08.795842    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:09.295823206 +0000 UTC m=+37.774775742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:08.796075 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.796054    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1616a665-1311-4a3f-a1e4-7289ffbc3994-config\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.796143 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.796060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-trusted-ca\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.797272 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.797245    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1616a665-1311-4a3f-a1e4-7289ffbc3994-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.797755 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.797720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c90da4-e4d1-420a-88ab-4fb8b73da803-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.797906 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.797884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3b6db22-9111-4be1-914a-d9b20fe23666-cert\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.798016 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.797993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-serving-cert\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.803852 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.803826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhncg\" (UniqueName: \"kubernetes.io/projected/1616a665-1311-4a3f-a1e4-7289ffbc3994-kube-api-access-zhncg\") pod \"service-ca-operator-5bcbc94c78-mm97x\" (UID: \"1616a665-1311-4a3f-a1e4-7289ffbc3994\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.804282 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.804244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rvj\" (UniqueName: \"kubernetes.io/projected/aa6a3983-ffc9-40ce-b007-a07b810ed1e3-kube-api-access-x2rvj\") pod \"console-operator-565b7b569d-tkj7z\" (UID: \"aa6a3983-ffc9-40ce-b007-a07b810ed1e3\") " pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.805142 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.805091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnxpk\" (UniqueName: \"kubernetes.io/projected/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-kube-api-access-lnxpk\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:08.805229 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.805146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n997j\" (UniqueName: \"kubernetes.io/projected/d3b6db22-9111-4be1-914a-d9b20fe23666-kube-api-access-n997j\") pod \"ingress-canary-nmwqb\" (UID: \"d3b6db22-9111-4be1-914a-d9b20fe23666\") " pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.805874 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.805849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9bm6\" (UniqueName: \"kubernetes.io/projected/26c90da4-e4d1-420a-88ab-4fb8b73da803-kube-api-access-v9bm6\") pod \"kube-storage-version-migrator-operator-7658d9b749-mvbp4\" (UID: \"26c90da4-e4d1-420a-88ab-4fb8b73da803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.805952 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.805874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfsml\" (UniqueName: \"kubernetes.io/projected/436f3e3a-f406-49c2-8a98-b6911e709b24-kube-api-access-cfsml\") pod \"network-check-source-7bc5b6bf85-fjjct\" (UID: \"436f3e3a-f406-49c2-8a98-b6911e709b24\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"
Jul 17 21:46:08.815793 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.815769    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"
Jul 17 21:46:08.832683 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.832657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:08.842890 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.842863    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"
Jul 17 21:46:08.854679 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.854382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"
Jul 17 21:46:08.887103 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.887011    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmwqb"
Jul 17 21:46:08.903086 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.903039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"
Jul 17 21:46:08.995533 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:08.992496    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v6kxc"]
Jul 17 21:46:09.004968 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.002813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:09.004968 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.002811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:09.004968 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.003282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:09.007999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.006865    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbv8k\""
Jul 17 21:46:09.007999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.006908    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:46:09.007999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.007090    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:46:09.007999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.007383    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-28dc9\""
Jul 17 21:46:09.011782 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.011564    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw"]
Jul 17 21:46:09.067924 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.067854    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e1534b_5606_4852_b4bc_4248d1d138f7.slice/crio-d2572ab752fe34c8bb557e8f611a2c4a103242e62c96bf1778e5cba837e315c4 WatchSource:0}: Error finding container d2572ab752fe34c8bb557e8f611a2c4a103242e62c96bf1778e5cba837e315c4: Status 404 returned error can't find the container with id d2572ab752fe34c8bb557e8f611a2c4a103242e62c96bf1778e5cba837e315c4
Jul 17 21:46:09.068543 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.068517    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08e3bea_5c32_4aac_9397_04375fc890ca.slice/crio-dcba7dfe27e2aee22219b711fa4914ce04c343ac7c62e80f4bdf1f500cf72786 WatchSource:0}: Error finding container dcba7dfe27e2aee22219b711fa4914ce04c343ac7c62e80f4bdf1f500cf72786: Status 404 returned error can't find the container with id dcba7dfe27e2aee22219b711fa4914ce04c343ac7c62e80f4bdf1f500cf72786
Jul 17 21:46:09.082390 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.082272    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tkj7z"]
Jul 17 21:46:09.087217 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.087193    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6a3983_ffc9_40ce_b007_a07b810ed1e3.slice/crio-af99171784bfbe035de55e01516adad94881e8d0e73aa8e0d00907780f6bf424 WatchSource:0}: Error finding container af99171784bfbe035de55e01516adad94881e8d0e73aa8e0d00907780f6bf424: Status 404 returned error can't find the container with id af99171784bfbe035de55e01516adad94881e8d0e73aa8e0d00907780f6bf424
Jul 17 21:46:09.103466 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.103439    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c90da4_e4d1_420a_88ab_4fb8b73da803.slice/crio-9d03537602aa4c3165995ea6216ca69292f533846261d94896731b251f6ecf41 WatchSource:0}: Error finding container 9d03537602aa4c3165995ea6216ca69292f533846261d94896731b251f6ecf41: Status 404 returned error can't find the container with id 9d03537602aa4c3165995ea6216ca69292f533846261d94896731b251f6ecf41
Jul 17 21:46:09.103947 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.103909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4"]
Jul 17 21:46:09.105679 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.105569    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x"]
Jul 17 21:46:09.106112 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.106087    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1616a665_1311_4a3f_a1e4_7289ffbc3994.slice/crio-2e5c7782b3e53f3979c037d7c68d68ffd06e4a4a421b89d8b1047d8c4ae76f3e WatchSource:0}: Error finding container 2e5c7782b3e53f3979c037d7c68d68ffd06e4a4a421b89d8b1047d8c4ae76f3e: Status 404 returned error can't find the container with id 2e5c7782b3e53f3979c037d7c68d68ffd06e4a4a421b89d8b1047d8c4ae76f3e
Jul 17 21:46:09.127013 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.126991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmwqb"]
Jul 17 21:46:09.129854 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.129827    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b6db22_9111_4be1_914a_d9b20fe23666.slice/crio-e3594a79ecd88f400bc4005091d59d9d0e05463485b701097ac44572ef0f9c43 WatchSource:0}: Error finding container e3594a79ecd88f400bc4005091d59d9d0e05463485b701097ac44572ef0f9c43: Status 404 returned error can't find the container with id e3594a79ecd88f400bc4005091d59d9d0e05463485b701097ac44572ef0f9c43
Jul 17 21:46:09.179698 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.179660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmwqb" event={"ID":"d3b6db22-9111-4be1-914a-d9b20fe23666","Type":"ContainerStarted","Data":"e3594a79ecd88f400bc4005091d59d9d0e05463485b701097ac44572ef0f9c43"}
Jul 17 21:46:09.181470 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.181381    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" event={"ID":"aa6a3983-ffc9-40ce-b007-a07b810ed1e3","Type":"ContainerStarted","Data":"af99171784bfbe035de55e01516adad94881e8d0e73aa8e0d00907780f6bf424"}
Jul 17 21:46:09.183007 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.182976    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v6kxc" event={"ID":"51e1534b-5606-4852-b4bc-4248d1d138f7","Type":"ContainerStarted","Data":"d2572ab752fe34c8bb557e8f611a2c4a103242e62c96bf1778e5cba837e315c4"}
Jul 17 21:46:09.184583 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.184557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x" event={"ID":"1616a665-1311-4a3f-a1e4-7289ffbc3994","Type":"ContainerStarted","Data":"2e5c7782b3e53f3979c037d7c68d68ffd06e4a4a421b89d8b1047d8c4ae76f3e"}
Jul 17 21:46:09.185885 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.185853    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw" event={"ID":"c08e3bea-5c32-4aac-9397-04375fc890ca","Type":"ContainerStarted","Data":"dcba7dfe27e2aee22219b711fa4914ce04c343ac7c62e80f4bdf1f500cf72786"}
Jul 17 21:46:09.187339 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.187311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4" event={"ID":"26c90da4-e4d1-420a-88ab-4fb8b73da803","Type":"ContainerStarted","Data":"9d03537602aa4c3165995ea6216ca69292f533846261d94896731b251f6ecf41"}
Jul 17 21:46:09.197879 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.197854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:09.197975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.197903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:09.197975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.197946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:09.198083 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.197998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:09.198083 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198012    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:09.198083 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198076    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.198055509 +0000 UTC m=+38.677008047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198101    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.198111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198109    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198154    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198164    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.198146593 +0000 UTC m=+38.677099143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198183    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.198173448 +0000 UTC m=+38.677125985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:09.198233 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198182    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:09.198546 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198245    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.198228608 +0000 UTC m=+38.677181143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:09.198546 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.198267    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.198257196 +0000 UTC m=+38.677209731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:09.230440 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.230418    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct"]
Jul 17 21:46:09.232850 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:09.232498    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436f3e3a_f406_49c2_8a98_b6911e709b24.slice/crio-250202092c4ef8de3328f76621c1aa6e1979a50f06e2ac9ab27560d9f226c64d WatchSource:0}: Error finding container 250202092c4ef8de3328f76621c1aa6e1979a50f06e2ac9ab27560d9f226c64d: Status 404 returned error can't find the container with id 250202092c4ef8de3328f76621c1aa6e1979a50f06e2ac9ab27560d9f226c64d
Jul 17 21:46:09.299577 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:09.299531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:09.299784 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.299672    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:09.299784 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:09.299725    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:10.29971064 +0000 UTC m=+38.778663176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:10.196947 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.196906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct" event={"ID":"436f3e3a-f406-49c2-8a98-b6911e709b24","Type":"ContainerStarted","Data":"250202092c4ef8de3328f76621c1aa6e1979a50f06e2ac9ab27560d9f226c64d"}
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.207739    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="b5c7ec033a9c5b907e891c8a1261cc46ca9ae45f9846ccf6233221cd6d6b71c8" exitCode=0
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.207816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"b5c7ec033a9c5b907e891c8a1261cc46ca9ae45f9846ccf6233221cd6d6b71c8"}
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.208710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.208769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.208834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.208874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.208918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209047    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209061    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209107    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.209089891 +0000 UTC m=+40.688042439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209641    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209689    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.209672973 +0000 UTC m=+40.688625525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209745    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209776    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.209765506 +0000 UTC m=+40.688718056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209845    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.209834742 +0000 UTC m=+40.688787279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:10.209958 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209897    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:10.211105 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.209927    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.209917059 +0000 UTC m=+40.688869608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:10.311493 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:10.309605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:10.311493 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.309896    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:10.311493 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:10.309961    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:12.309940279 +0000 UTC m=+40.788892833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:11.219958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:11.219869    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96e3ab-1a01-462f-8e8f-2a3c660449a5" containerID="cf0667c57e790d018a27dc1f65aa989b2a14725777fbf91f3d718f682f06aafc" exitCode=0
Jul 17 21:46:11.220732 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:11.219957    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerDied","Data":"cf0667c57e790d018a27dc1f65aa989b2a14725777fbf91f3d718f682f06aafc"}
Jul 17 21:46:12.228424 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.228394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.228448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.228498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.228556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228583    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228602    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228638    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.228643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228675    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.228650955 +0000 UTC m=+44.707603490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228713    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228747    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.228734059 +0000 UTC m=+44.707686592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228766    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.228756258 +0000 UTC m=+44.707708795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228780    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228784    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.228776566 +0000 UTC m=+44.707729100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:12.229030 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.228822    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.228807561 +0000 UTC m=+44.707760101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:12.329939 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:12.329901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:12.330077 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.330057    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:12.330125 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:12.330119    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:16.330101498 +0000 UTC m=+44.809054052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:16.265841 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.265804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.265864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.265918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.265985    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266011    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266030    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.265990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266074    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.266055353 +0000 UTC m=+52.745007890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266099    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266105    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.266089941 +0000 UTC m=+52.745042475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266127    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.266116608 +0000 UTC m=+52.745069143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266145    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.266136598 +0000 UTC m=+52.745089133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.266191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266280    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:16.266416 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.266317    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.26630672 +0000 UTC m=+52.745259263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:16.366972 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:16.366930    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:16.367165 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.367081    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:16.367165 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:16.367147    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:24.367129655 +0000 UTC m=+52.846082209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:17.250298 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.249447    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4" event={"ID":"26c90da4-e4d1-420a-88ab-4fb8b73da803","Type":"ContainerStarted","Data":"9630c1209d32a56dcf885c1317713db1a51daf8a8631f7b3c166fb326d558583"}
Jul 17 21:46:17.254442 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.253938    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct" event={"ID":"436f3e3a-f406-49c2-8a98-b6911e709b24","Type":"ContainerStarted","Data":"ede3bcce4efa2a915637052fa0d7d66c098f1ac6961e68aff0ea431de792f79d"}
Jul 17 21:46:17.259708 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.259664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" event={"ID":"9c96e3ab-1a01-462f-8e8f-2a3c660449a5","Type":"ContainerStarted","Data":"dbf8407eb753477bfc3f46de59997e8a7652433986a0aa35ab018c96d5e95363"}
Jul 17 21:46:17.265644 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.262174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmwqb" event={"ID":"d3b6db22-9111-4be1-914a-d9b20fe23666","Type":"ContainerStarted","Data":"d11c9817167efba5378414efca0c68822aaf884072b191835942ce3de44e57fb"}
Jul 17 21:46:17.265644 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.264420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" event={"ID":"aa6a3983-ffc9-40ce-b007-a07b810ed1e3","Type":"ContainerStarted","Data":"da06e8717306f32ff20fdb924c9448f9b055549517c4173509e3dfc66d4f6c43"}
Jul 17 21:46:17.269638 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.266245    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:17.269638 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.266348    2570 patch_prober.go:28] interesting pod/console-operator-565b7b569d-tkj7z container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 17 21:46:17.269638 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.266390    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" podUID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 17 21:46:17.273633 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.270269    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v6kxc" event={"ID":"51e1534b-5606-4852-b4bc-4248d1d138f7","Type":"ContainerStarted","Data":"a4b3eb418d940b7dd4888ec223d5296445c3809f12f4ad285906784b275e11c7"}
Jul 17 21:46:17.273633 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.273355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x" event={"ID":"1616a665-1311-4a3f-a1e4-7289ffbc3994","Type":"ContainerStarted","Data":"653b7275e5377f94ccbbd1f06b451b4163398b1d2f0e9b16469b0f70679bb100"}
Jul 17 21:46:17.277474 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.276489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw" event={"ID":"c08e3bea-5c32-4aac-9397-04375fc890ca","Type":"ContainerStarted","Data":"16dcdb6571b381b0e7ee18c6506de597e41c40d1893b3902b589b08d2f005d12"}
Jul 17 21:46:17.292239 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.290967    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4" podStartSLOduration=15.558714095 podStartE2EDuration="23.290948552s" totalImagesPullingTime="7.732234457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.270888386 +0000 UTC m=+45.749840943" watchObservedRunningTime="2026-07-17 21:46:17.290948552 +0000 UTC m=+45.769901108"
Jul 17 21:46:17.292239 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.291522    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-v6kxc" podStartSLOduration=22.552545289 podStartE2EDuration="30.29150569s" totalImagesPullingTime="7.738960401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.290369952 +0000 UTC m=+45.769322522" watchObservedRunningTime="2026-07-17 21:46:17.29150569 +0000 UTC m=+45.770458247"
Jul 17 21:46:17.332772 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.332187    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjjct" podStartSLOduration=12.486964072 podStartE2EDuration="20.33216445s" totalImagesPullingTime="7.845200378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.308719756 +0000 UTC m=+45.787672309" watchObservedRunningTime="2026-07-17 21:46:17.33216445 +0000 UTC m=+45.811116999"
Jul 17 21:46:17.332772 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.332455    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sh5j2" podStartSLOduration=12.991611473 podStartE2EDuration="45.332444241s" totalImagesPullingTime="32.340832768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.330307428 +0000 UTC m=+45.809260010" watchObservedRunningTime="2026-07-17 21:46:17.332444241 +0000 UTC m=+45.811396804"
Jul 17 21:46:17.349713 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.349375    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" podStartSLOduration=19.608983324 podStartE2EDuration="27.349354013s" totalImagesPullingTime="7.740370689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.349219975 +0000 UTC m=+45.828172544" watchObservedRunningTime="2026-07-17 21:46:17.349354013 +0000 UTC m=+45.828306571"
Jul 17 21:46:17.367653 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.367569    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4c5lw" podStartSLOduration=20.630665502 podStartE2EDuration="28.367546952s" totalImagesPullingTime="7.73688145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.36621264 +0000 UTC m=+45.845165197" watchObservedRunningTime="2026-07-17 21:46:17.367546952 +0000 UTC m=+45.846499509"
Jul 17 21:46:17.403964 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.403893    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x" podStartSLOduration=13.674655695 podStartE2EDuration="21.403868005s" totalImagesPullingTime="7.72921231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.402346634 +0000 UTC m=+45.881299193" watchObservedRunningTime="2026-07-17 21:46:17.403868005 +0000 UTC m=+45.882820563"
Jul 17 21:46:17.404772 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:17.404716    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nmwqb" podStartSLOduration=1.693659547 podStartE2EDuration="9.404702182s" totalImagesPullingTime="7.711042635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:17.381976321 +0000 UTC m=+45.860928878" watchObservedRunningTime="2026-07-17 21:46:17.404702182 +0000 UTC m=+45.883654739"
Jul 17 21:46:18.282907 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.282875    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/0.log"
Jul 17 21:46:18.283322 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.282924    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3" containerID="da06e8717306f32ff20fdb924c9448f9b055549517c4173509e3dfc66d4f6c43" exitCode=255
Jul 17 21:46:18.283869 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.283837    2570 scope.go:117] "RemoveContainer" containerID="da06e8717306f32ff20fdb924c9448f9b055549517c4173509e3dfc66d4f6c43"
Jul 17 21:46:18.285515 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.285489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" event={"ID":"aa6a3983-ffc9-40ce-b007-a07b810ed1e3","Type":"ContainerDied","Data":"da06e8717306f32ff20fdb924c9448f9b055549517c4173509e3dfc66d4f6c43"}
Jul 17 21:46:18.303800 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.303769    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8xktq"]
Jul 17 21:46:18.335587 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.335291    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8xktq"]
Jul 17 21:46:18.335587 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.335447    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.337867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.337846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 21:46:18.338024 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.337845    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 21:46:18.338133 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.337851    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9pf4b\""
Jul 17 21:46:18.389678 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.389643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-data-volume\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.389827 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.389692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.389886 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.389870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.389965 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.389945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shh5l\" (UniqueName: \"kubernetes.io/projected/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-api-access-shh5l\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.390256 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.390229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-crio-socket\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491013 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.490978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shh5l\" (UniqueName: \"kubernetes.io/projected/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-api-access-shh5l\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491178 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-crio-socket\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491178 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-data-volume\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491178 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491178 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491390 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-crio-socket\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.491390 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.491238    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:46:18.491390 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.491267    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:18.491390 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.491308    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:18.991287272 +0000 UTC m=+47.470239828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : configmap "kube-rbac-proxy" not found
Jul 17 21:46:18.491390 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.491326    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:18.991317721 +0000 UTC m=+47.470270256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:18.491562 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.491485    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-data-volume\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.502892 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.502866    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shh5l\" (UniqueName: \"kubernetes.io/projected/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-api-access-shh5l\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.833365 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.833328    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:18.995337 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.995297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.995514 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:18.995349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:18.995514 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.995424    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:46:18.995514 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.995435    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:18.995514 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.995494    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:19.995481255 +0000 UTC m=+48.474433788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:18.995514 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:18.995507    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:19.995500665 +0000 UTC m=+48.474453200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : configmap "kube-rbac-proxy" not found
Jul 17 21:46:19.288541 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.288516    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:46:19.288949 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.288929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/0.log"
Jul 17 21:46:19.288999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.288962    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3" containerID="36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290" exitCode=255
Jul 17 21:46:19.289054 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.289004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" event={"ID":"aa6a3983-ffc9-40ce-b007-a07b810ed1e3","Type":"ContainerDied","Data":"36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290"}
Jul 17 21:46:19.289054 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.289045    2570 scope.go:117] "RemoveContainer" containerID="da06e8717306f32ff20fdb924c9448f9b055549517c4173509e3dfc66d4f6c43"
Jul 17 21:46:19.289331 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.289304    2570 scope.go:117] "RemoveContainer" containerID="36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290"
Jul 17 21:46:19.289516 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:19.289482    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tkj7z_openshift-console-operator(aa6a3983-ffc9-40ce-b007-a07b810ed1e3)\"" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" podUID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3"
Jul 17 21:46:19.711297 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:19.711217    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hkgbn_45105e01-7ce4-4351-8485-20ea0a18d1f3/dns-node-resolver/0.log"
Jul 17 21:46:20.005751 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:20.005665    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:20.005751 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:20.005712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:20.005977 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:20.005788    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:46:20.005977 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:20.005853    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:22.005834471 +0000 UTC m=+50.484787023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : configmap "kube-rbac-proxy" not found
Jul 17 21:46:20.005977 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:20.005877    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:20.005977 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:20.005925    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:22.005911447 +0000 UTC m=+50.484864012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:20.293523 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:20.293499    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:46:20.294039 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:20.293931    2570 scope.go:117] "RemoveContainer" containerID="36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290"
Jul 17 21:46:20.294152 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:20.294130    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tkj7z_openshift-console-operator(aa6a3983-ffc9-40ce-b007-a07b810ed1e3)\"" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" podUID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3"
Jul 17 21:46:21.105382 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:21.105354    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2vxh_e5e6c285-6810-4a59-aa56-a8572a296881/node-ca/0.log"
Jul 17 21:46:21.511525 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:21.511450    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmwqb_d3b6db22-9111-4be1-914a-d9b20fe23666/serve-healthcheck-canary/0.log"
Jul 17 21:46:22.023926 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:22.023891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:22.024127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:22.023940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:22.024127 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:22.024037    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:46:22.024127 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:22.024079    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:22.024127 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:22.024104    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:26.024085166 +0000 UTC m=+54.503037728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : configmap "kube-rbac-proxy" not found
Jul 17 21:46:22.024127 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:22.024122    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:26.024110969 +0000 UTC m=+54.503063502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:24.340278 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.340239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.340286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340384    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340428    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls podName:8ba9e578-8318-4518-8595-e2c8fe36dac0 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.340414116 +0000 UTC m=+68.819366650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sjstb" (UID: "8ba9e578-8318-4518-8595-e2c8fe36dac0") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.340423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340482    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.340465464 +0000 UTC m=+68.819418004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : configmap references non-existent config key: service-ca.crt
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.340524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340538    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340557    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d967fb88-4t9xd: secret "image-registry-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.340584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340595    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls podName:d4e9d99e-de6e-4e08-9332-10d05ba3a210 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.340581291 +0000 UTC m=+68.819533846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls") pod "image-registry-68d967fb88-4t9xd" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210") : secret "image-registry-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340677    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340716    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs podName:04d1086c-95a3-480d-bf97-637d78ab3117 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.340706112 +0000 UTC m=+68.819658646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs") pod "router-default-95685859b-f5ml8" (UID: "04d1086c-95a3-480d-bf97-637d78ab3117") : secret "router-metrics-certs-default" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340716    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 21:46:24.340856 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.340766    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls podName:a8fc246d-f514-45ec-9223-abdbad7d5e2e nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.340754388 +0000 UTC m=+68.819706921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7bjzf" (UID: "a8fc246d-f514-45ec-9223-abdbad7d5e2e") : secret "samples-operator-tls" not found
Jul 17 21:46:24.442048 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:24.442009    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:24.442214 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.442155    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:46:24.442253 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:24.442218    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls podName:9310e0ca-04ff-4ef3-9277-0ddcd7d7891c nodeName:}" failed. No retries permitted until 2026-07-17 21:46:40.442201259 +0000 UTC m=+68.921153793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls") pod "dns-default-8mj8j" (UID: "9310e0ca-04ff-4ef3-9277-0ddcd7d7891c") : secret "dns-default-metrics-tls" not found
Jul 17 21:46:26.055975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:26.055935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:26.056408 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:26.055984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:26.056408 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:26.056075    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:26.056408 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:26.056138    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls podName:87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9 nodeName:}" failed. No retries permitted until 2026-07-17 21:46:34.056122864 +0000 UTC m=+62.535075403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8xktq" (UID: "87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:46:26.056517 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:26.056469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:27.265455 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:27.265419    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:27.265901 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:27.265888    2570 scope.go:117] "RemoveContainer" containerID="36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290"
Jul 17 21:46:27.266113 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:46:27.266094    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tkj7z_openshift-console-operator(aa6a3983-ffc9-40ce-b007-a07b810ed1e3)\"" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" podUID="aa6a3983-ffc9-40ce-b007-a07b810ed1e3"
Jul 17 21:46:28.833459 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:28.833421    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:28.833863 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:28.833820    2570 scope.go:117] "RemoveContainer" containerID="36b2c89c198561f6165a0fad1cab92f2196a4232572a4a2118f954f59b9f6290"
Jul 17 21:46:29.321307 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:29.321276    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:46:29.321448 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:29.321347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z" event={"ID":"aa6a3983-ffc9-40ce-b007-a07b810ed1e3","Type":"ContainerStarted","Data":"12468bb3d0e5c11ed745e0bb0d61d881f782f7c75f7578f3b05cf2c82deebbf5"}
Jul 17 21:46:29.321659 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:29.321631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:29.326025 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:29.326008    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-tkj7z"
Jul 17 21:46:33.179480 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:33.179448    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7nnm5"
Jul 17 21:46:34.134694 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:34.134653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:34.137023 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:34.136994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8xktq\" (UID: \"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9\") " pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:34.259069 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:34.259040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9pf4b\""
Jul 17 21:46:34.264663 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:34.264643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8xktq"
Jul 17 21:46:34.408884 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:34.408798    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8xktq"]
Jul 17 21:46:34.411899 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:34.411873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d1d9d0_c5fe_4dc6_9ffe_b9ca2a401de9.slice/crio-a6024a4e3314aa57fa4c78b35445ecfc55bbf2b1fbffef768c16f29e0a3ad777 WatchSource:0}: Error finding container a6024a4e3314aa57fa4c78b35445ecfc55bbf2b1fbffef768c16f29e0a3ad777: Status 404 returned error can't find the container with id a6024a4e3314aa57fa4c78b35445ecfc55bbf2b1fbffef768c16f29e0a3ad777
Jul 17 21:46:35.341164 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:35.341125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8xktq" event={"ID":"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9","Type":"ContainerStarted","Data":"a6024a4e3314aa57fa4c78b35445ecfc55bbf2b1fbffef768c16f29e0a3ad777"}
Jul 17 21:46:37.769172 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.769140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:37.771434 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.771408    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:46:37.782549 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.782524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df12f5bb-4ab5-4df2-899e-5b6745e066aa-original-pull-secret\") pod \"global-pull-secret-syncer-rnn57\" (UID: \"df12f5bb-4ab5-4df2-899e-5b6745e066aa\") " pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:37.838912 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.838881    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnn57"
Jul 17 21:46:37.870815 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.870782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:37.872989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.872969    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:46:37.884138 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.884114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0abef86f-92d6-4155-a074-8234053b0fe6-metrics-certs\") pod \"network-metrics-daemon-vh2zh\" (UID: \"0abef86f-92d6-4155-a074-8234053b0fe6\") " pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:37.971726 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.971683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:37.974718 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:37.974692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqf98\" (UniqueName: \"kubernetes.io/projected/26bac29c-ec3d-4432-8e60-3a7e39a36eeb-kube-api-access-vqf98\") pod \"network-check-target-tllgr\" (UID: \"26bac29c-ec3d-4432-8e60-3a7e39a36eeb\") " pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:38.130183 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:38.130148    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbv8k\""
Jul 17 21:46:38.138088 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:38.138051    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vh2zh"
Jul 17 21:46:38.152806 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:38.152776    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-28dc9\""
Jul 17 21:46:38.160700 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:38.160674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:39.486898 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:39.486862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnn57"]
Jul 17 21:46:39.492105 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:39.492072    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf12f5bb_4ab5_4df2_899e_5b6745e066aa.slice/crio-69e81f68d37741193405bba31df8ff1e24c8713130177ff89c0cb718d3ee8e4b WatchSource:0}: Error finding container 69e81f68d37741193405bba31df8ff1e24c8713130177ff89c0cb718d3ee8e4b: Status 404 returned error can't find the container with id 69e81f68d37741193405bba31df8ff1e24c8713130177ff89c0cb718d3ee8e4b
Jul 17 21:46:39.507685 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:39.507647    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vh2zh"]
Jul 17 21:46:39.510774 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:39.510745    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abef86f_92d6_4155_a074_8234053b0fe6.slice/crio-ffc488a22b075bf0c7c77cdb03da5b5b4af1c65c7df760f03add2b00013335aa WatchSource:0}: Error finding container ffc488a22b075bf0c7c77cdb03da5b5b4af1c65c7df760f03add2b00013335aa: Status 404 returned error can't find the container with id ffc488a22b075bf0c7c77cdb03da5b5b4af1c65c7df760f03add2b00013335aa
Jul 17 21:46:39.526922 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:39.526900    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tllgr"]
Jul 17 21:46:39.529524 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:39.529503    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26bac29c_ec3d_4432_8e60_3a7e39a36eeb.slice/crio-01c82346e412fcddf177da558d889acc276d0aae3f1c9f0e3568544075814449 WatchSource:0}: Error finding container 01c82346e412fcddf177da558d889acc276d0aae3f1c9f0e3568544075814449: Status 404 returned error can't find the container with id 01c82346e412fcddf177da558d889acc276d0aae3f1c9f0e3568544075814449
Jul 17 21:46:40.362574 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.362478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnn57" event={"ID":"df12f5bb-4ab5-4df2-899e-5b6745e066aa","Type":"ContainerStarted","Data":"69e81f68d37741193405bba31df8ff1e24c8713130177ff89c0cb718d3ee8e4b"}
Jul 17 21:46:40.364150 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.364115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vh2zh" event={"ID":"0abef86f-92d6-4155-a074-8234053b0fe6","Type":"ContainerStarted","Data":"ffc488a22b075bf0c7c77cdb03da5b5b4af1c65c7df760f03add2b00013335aa"}
Jul 17 21:46:40.366081 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.366053    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8xktq" event={"ID":"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9","Type":"ContainerStarted","Data":"4e2282f660e5635b1cdc0bbc1483e6f6e6444b1e52c73691f7e9aba5aa8a88f6"}
Jul 17 21:46:40.368252 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.368174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tllgr" event={"ID":"26bac29c-ec3d-4432-8e60-3a7e39a36eeb","Type":"ContainerStarted","Data":"f77777f40a67e835e30a4df088827834bd8e1a32560dc7899702a24bd41c7a68"}
Jul 17 21:46:40.368252 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.368218    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tllgr" event={"ID":"26bac29c-ec3d-4432-8e60-3a7e39a36eeb","Type":"ContainerStarted","Data":"01c82346e412fcddf177da558d889acc276d0aae3f1c9f0e3568544075814449"}
Jul 17 21:46:40.368437 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.368304    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:46:40.391020 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.390796    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tllgr" podStartSLOduration=68.39077699 podStartE2EDuration="1m8.39077699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:40.390274315 +0000 UTC m=+68.869226876" watchObservedRunningTime="2026-07-17 21:46:40.39077699 +0000 UTC m=+68.869729546"
Jul 17 21:46:40.394660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.394322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:40.394660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.394367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:40.394660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.394391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:40.394660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.394413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:40.394660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.394433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:40.395735 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.395711    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d1086c-95a3-480d-bf97-637d78ab3117-service-ca-bundle\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:40.397390 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.397366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ba9e578-8318-4518-8595-e2c8fe36dac0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sjstb\" (UID: \"8ba9e578-8318-4518-8595-e2c8fe36dac0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:40.397840 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.397809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"image-registry-68d967fb88-4t9xd\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") " pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:40.398341 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.398319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d1086c-95a3-480d-bf97-637d78ab3117-metrics-certs\") pod \"router-default-95685859b-f5ml8\" (UID: \"04d1086c-95a3-480d-bf97-637d78ab3117\") " pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:40.398687 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.398667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8fc246d-f514-45ec-9223-abdbad7d5e2e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7bjzf\" (UID: \"a8fc246d-f514-45ec-9223-abdbad7d5e2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:40.495530 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.495494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:40.499011 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.498982    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9310e0ca-04ff-4ef3-9277-0ddcd7d7891c-metrics-tls\") pod \"dns-default-8mj8j\" (UID: \"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c\") " pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:40.572035 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.572004    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r662j\""
Jul 17 21:46:40.581108 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.581024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"
Jul 17 21:46:40.584932 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.584906    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6j6px\""
Jul 17 21:46:40.593890 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.593866    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:40.597297 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.597278    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gc6z4\""
Jul 17 21:46:40.606260 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.606173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:40.610796 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.610573    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7cxtk\""
Jul 17 21:46:40.618025 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.617789    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"
Jul 17 21:46:40.674072 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.674045    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q82nm\""
Jul 17 21:46:40.683180 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:40.682884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:41.184225 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.183951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8mj8j"]
Jul 17 21:46:41.206275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.206206    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-95685859b-f5ml8"]
Jul 17 21:46:41.212086 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.212022    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:46:41.225045 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:41.224283    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e9d99e_de6e_4e08_9332_10d05ba3a210.slice/crio-82cc9d65af51e4d96b9f8e0a8e36553f7f0b4ee687afec097ff1c24617e45398 WatchSource:0}: Error finding container 82cc9d65af51e4d96b9f8e0a8e36553f7f0b4ee687afec097ff1c24617e45398: Status 404 returned error can't find the container with id 82cc9d65af51e4d96b9f8e0a8e36553f7f0b4ee687afec097ff1c24617e45398
Jul 17 21:46:41.246837 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.246771    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb"]
Jul 17 21:46:41.254586 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:46:41.254561    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba9e578_8318_4518_8595_e2c8fe36dac0.slice/crio-74a3b6db15272fa8a40244a5419c38dae258f4fca104d2ee43f74c3aeb16ba81 WatchSource:0}: Error finding container 74a3b6db15272fa8a40244a5419c38dae258f4fca104d2ee43f74c3aeb16ba81: Status 404 returned error can't find the container with id 74a3b6db15272fa8a40244a5419c38dae258f4fca104d2ee43f74c3aeb16ba81
Jul 17 21:46:41.270986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.270952    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf"]
Jul 17 21:46:41.375016 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.374926    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj8j" event={"ID":"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c","Type":"ContainerStarted","Data":"d5bcdf240440e56b480b76fb5a0eb19f6762f9cbd749d1bd9a22e1f703d14f09"}
Jul 17 21:46:41.377934 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.377837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf" event={"ID":"a8fc246d-f514-45ec-9223-abdbad7d5e2e","Type":"ContainerStarted","Data":"2766d2846c7f3b380b1ef1c16e3949eeac094e588a3d952b18f28eb5a55d2657"}
Jul 17 21:46:41.379538 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.379465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb" event={"ID":"8ba9e578-8318-4518-8595-e2c8fe36dac0","Type":"ContainerStarted","Data":"74a3b6db15272fa8a40244a5419c38dae258f4fca104d2ee43f74c3aeb16ba81"}
Jul 17 21:46:41.382291 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.382262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-95685859b-f5ml8" event={"ID":"04d1086c-95a3-480d-bf97-637d78ab3117","Type":"ContainerStarted","Data":"c2e14912678eb8962903a2575e5c0accd4075ce3c8627f4101607d0ba3cce9bd"}
Jul 17 21:46:41.382426 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.382313    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-95685859b-f5ml8" event={"ID":"04d1086c-95a3-480d-bf97-637d78ab3117","Type":"ContainerStarted","Data":"9c3961676b3cddbf6e3cbacc2d56b0a4c66067b17a728fc8213df8a1a18bbdfd"}
Jul 17 21:46:41.385403 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.385373    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vh2zh" event={"ID":"0abef86f-92d6-4155-a074-8234053b0fe6","Type":"ContainerStarted","Data":"270dc812760558546e0a6269fcf1e26e3fe0c32edf101edbf5b59d2ed46cf26a"}
Jul 17 21:46:41.385505 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.385428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vh2zh" event={"ID":"0abef86f-92d6-4155-a074-8234053b0fe6","Type":"ContainerStarted","Data":"57626071a7ae9345226942260e8183fa963dd517de52d9f3a4dd579080f26bfb"}
Jul 17 21:46:41.387828 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.387799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" event={"ID":"d4e9d99e-de6e-4e08-9332-10d05ba3a210","Type":"ContainerStarted","Data":"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"}
Jul 17 21:46:41.388499 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.388438    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:46:41.388499 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.388471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" event={"ID":"d4e9d99e-de6e-4e08-9332-10d05ba3a210","Type":"ContainerStarted","Data":"82cc9d65af51e4d96b9f8e0a8e36553f7f0b4ee687afec097ff1c24617e45398"}
Jul 17 21:46:41.406281 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.406217    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-95685859b-f5ml8" podStartSLOduration=54.406194458 podStartE2EDuration="54.406194458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:41.404552945 +0000 UTC m=+69.883505502" watchObservedRunningTime="2026-07-17 21:46:41.406194458 +0000 UTC m=+69.885147015"
Jul 17 21:46:41.426354 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.426302    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vh2zh" podStartSLOduration=67.992735213 podStartE2EDuration="1m9.426287094s" totalImagesPullingTime="1.433551881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:41.425312655 +0000 UTC m=+69.904265213" watchObservedRunningTime="2026-07-17 21:46:41.426287094 +0000 UTC m=+69.905239652"
Jul 17 21:46:41.607113 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.607080    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:41.610827 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.610794    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:41.645847 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:41.645784    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" podStartSLOduration=69.645761189 podStartE2EDuration="1m9.645761189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:41.450364731 +0000 UTC m=+69.929317295" watchObservedRunningTime="2026-07-17 21:46:41.645761189 +0000 UTC m=+70.124713740"
Jul 17 21:46:42.392840 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:42.392808    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:42.394388 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:42.394361    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-95685859b-f5ml8"
Jul 17 21:46:48.423593 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:48.423563    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8xktq" event={"ID":"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9","Type":"ContainerStarted","Data":"9b815bf410186de6b3d97e94011d3e9d847db8a99ef72325ef2d8102dd19b728"}
Jul 17 21:46:49.429161 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.429124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb" event={"ID":"8ba9e578-8318-4518-8595-e2c8fe36dac0","Type":"ContainerStarted","Data":"033179abfad243269877480e0c5d59323f79bd0709040639168b64d7582f0bb5"}
Jul 17 21:46:49.431196 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.431171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnn57" event={"ID":"df12f5bb-4ab5-4df2-899e-5b6745e066aa","Type":"ContainerStarted","Data":"4ef8887358f071f0bbb3e473f9e044fc62919a595f9ee0c076fc3826d5ba589e"}
Jul 17 21:46:49.433337 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.433312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj8j" event={"ID":"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c","Type":"ContainerStarted","Data":"3ff6acd82fff756ebbe793ba55189cc77efc94244a246aa82f1c0dea74dfd5b7"}
Jul 17 21:46:49.433437 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.433362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj8j" event={"ID":"9310e0ca-04ff-4ef3-9277-0ddcd7d7891c","Type":"ContainerStarted","Data":"68b4a50d75fbdb7280d29b9afc289df8ba64d883000304f983d74302ba1c6747"}
Jul 17 21:46:49.433437 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.433413    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:46:49.435319 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.435297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf" event={"ID":"a8fc246d-f514-45ec-9223-abdbad7d5e2e","Type":"ContainerStarted","Data":"d1ddfeb10df556a4b78a0379089960f6141aadda25bafa8b8eb4dde4af9bc495"}
Jul 17 21:46:49.435430 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.435339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf" event={"ID":"a8fc246d-f514-45ec-9223-abdbad7d5e2e","Type":"ContainerStarted","Data":"f8310bb9844371777f532611ea715452d9ecd0fd08d8e208a865c79c222974ee"}
Jul 17 21:46:49.472746 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.472677    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sjstb" podStartSLOduration=55.463140084 podStartE2EDuration="1m2.472655223s" totalImagesPullingTime="7.009515139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:49.450292423 +0000 UTC m=+77.929244979" watchObservedRunningTime="2026-07-17 21:46:49.472655223 +0000 UTC m=+77.951607783"
Jul 17 21:46:49.473468 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.473421    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7bjzf" podStartSLOduration=53.494257128 podStartE2EDuration="1m0.473408737s" totalImagesPullingTime="6.979151609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:49.472262928 +0000 UTC m=+77.951215491" watchObservedRunningTime="2026-07-17 21:46:49.473408737 +0000 UTC m=+77.952361295"
Jul 17 21:46:49.493427 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.493381    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8mj8j" podStartSLOduration=34.390961907 podStartE2EDuration="41.493366903s" totalImagesPullingTime="7.102404996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:49.49236013 +0000 UTC m=+77.971312687" watchObservedRunningTime="2026-07-17 21:46:49.493366903 +0000 UTC m=+77.972319458"
Jul 17 21:46:49.517591 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:49.517535    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rnn57" podStartSLOduration=68.74303519 podStartE2EDuration="1m17.517513807s" totalImagesPullingTime="8.774478617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:49.515295441 +0000 UTC m=+77.994247998" watchObservedRunningTime="2026-07-17 21:46:49.517513807 +0000 UTC m=+77.996466363"
Jul 17 21:46:53.455691 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:53.455561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8xktq" event={"ID":"87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9","Type":"ContainerStarted","Data":"a7b37d96d18be5d72f3bc7815a3df64d007187ef67b19abedc17ad6003d8d0f2"}
Jul 17 21:46:53.478055 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:53.477929    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8xktq" podStartSLOduration=17.704367346 podStartE2EDuration="35.47791202s" totalImagesPullingTime="17.773544674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:46:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:53.477214717 +0000 UTC m=+81.956167285" watchObservedRunningTime="2026-07-17 21:46:53.47791202 +0000 UTC m=+81.956864577"
Jul 17 21:46:59.446098 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:46:59.446066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8mj8j"
Jul 17 21:47:02.396876 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:02.396846    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:47:02.530669 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:02.530638    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:47:07.369407 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.369372    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pg87s"]
Jul 17 21:47:07.372248 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.372232    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.374504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.374482    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 21:47:07.374504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.374494    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 21:47:07.374710 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.374514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5ndnc\""
Jul 17 21:47:07.374710 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.374539    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 21:47:07.375276 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.375259    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 21:47:07.407633 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407633 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-sys\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407658    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-textfile\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fs8x\" (UniqueName: \"kubernetes.io/projected/4218d713-9c7c-4ff3-be9f-944dfaf65a59-kube-api-access-4fs8x\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-metrics-client-ca\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-wtmp\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.407913 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.407877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-root\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509199 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-root\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-sys\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-textfile\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-root\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-sys\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fs8x\" (UniqueName: \"kubernetes.io/projected/4218d713-9c7c-4ff3-be9f-944dfaf65a59-kube-api-access-4fs8x\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509728 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-metrics-client-ca\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509728 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:47:07.509407    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 21:47:07.509728 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:47:07.509476    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls podName:4218d713-9c7c-4ff3-be9f-944dfaf65a59 nodeName:}" failed. No retries permitted until 2026-07-17 21:47:08.009455173 +0000 UTC m=+96.488407710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls") pod "node-exporter-pg87s" (UID: "4218d713-9c7c-4ff3-be9f-944dfaf65a59") : secret "node-exporter-tls" not found
Jul 17 21:47:07.509728 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-wtmp\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509728 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-textfile\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509902 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-wtmp\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.509993 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.510033 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.509989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4218d713-9c7c-4ff3-be9f-944dfaf65a59-metrics-client-ca\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.511728 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.511713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:07.519485 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:07.519462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fs8x\" (UniqueName: \"kubernetes.io/projected/4218d713-9c7c-4ff3-be9f-944dfaf65a59-kube-api-access-4fs8x\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:08.014225 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:08.014190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:08.016595 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:08.016575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4218d713-9c7c-4ff3-be9f-944dfaf65a59-node-exporter-tls\") pod \"node-exporter-pg87s\" (UID: \"4218d713-9c7c-4ff3-be9f-944dfaf65a59\") " pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:08.281912 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:08.281840    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pg87s"
Jul 17 21:47:08.349702 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:47:08.349669    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4218d713_9c7c_4ff3_be9f_944dfaf65a59.slice/crio-13556467a419508845de8187367cbfad8e691e34ca4b9277165f3bfd193848bb WatchSource:0}: Error finding container 13556467a419508845de8187367cbfad8e691e34ca4b9277165f3bfd193848bb: Status 404 returned error can't find the container with id 13556467a419508845de8187367cbfad8e691e34ca4b9277165f3bfd193848bb
Jul 17 21:47:08.509934 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:08.509893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg87s" event={"ID":"4218d713-9c7c-4ff3-be9f-944dfaf65a59","Type":"ContainerStarted","Data":"13556467a419508845de8187367cbfad8e691e34ca4b9277165f3bfd193848bb"}
Jul 17 21:47:10.519917 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:10.519885    2570 generic.go:356] "Generic (PLEG): container finished" podID="4218d713-9c7c-4ff3-be9f-944dfaf65a59" containerID="9d291673482519a2be23a3a645fadec193fbc597d0b296d84a561a3d839826f1" exitCode=0
Jul 17 21:47:10.520314 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:10.519982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg87s" event={"ID":"4218d713-9c7c-4ff3-be9f-944dfaf65a59","Type":"ContainerDied","Data":"9d291673482519a2be23a3a645fadec193fbc597d0b296d84a561a3d839826f1"}
Jul 17 21:47:11.390902 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:11.390872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tllgr"
Jul 17 21:47:11.525678 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:11.525648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg87s" event={"ID":"4218d713-9c7c-4ff3-be9f-944dfaf65a59","Type":"ContainerStarted","Data":"51c38df2f925c56139a8a04e03969a2a6b24c23c091990766cefb76c4dc4bf6c"}
Jul 17 21:47:11.526091 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:11.525698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg87s" event={"ID":"4218d713-9c7c-4ff3-be9f-944dfaf65a59","Type":"ContainerStarted","Data":"af9da85488cb708c489163598d9d248026a5527f4f061325b42a457f66bc00ca"}
Jul 17 21:47:11.548421 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:11.546001    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pg87s" podStartSLOduration=2.813075154 podStartE2EDuration="4.5459813s" totalImagesPullingTime="1.639941521s" totalInitContainerRuntime="92.964625ms" isStatefulPod=true podCreationTimestamp="2026-07-17 21:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:47:11.544606625 +0000 UTC m=+100.023559182" watchObservedRunningTime="2026-07-17 21:47:11.5459813 +0000 UTC m=+100.024933861"
Jul 17 21:47:23.575576 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:23.575537    2570 generic.go:356] "Generic (PLEG): container finished" podID="51e1534b-5606-4852-b4bc-4248d1d138f7" containerID="a4b3eb418d940b7dd4888ec223d5296445c3809f12f4ad285906784b275e11c7" exitCode=0
Jul 17 21:47:23.576084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:23.575607    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v6kxc" event={"ID":"51e1534b-5606-4852-b4bc-4248d1d138f7","Type":"ContainerDied","Data":"a4b3eb418d940b7dd4888ec223d5296445c3809f12f4ad285906784b275e11c7"}
Jul 17 21:47:23.576084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:23.575970    2570 scope.go:117] "RemoveContainer" containerID="a4b3eb418d940b7dd4888ec223d5296445c3809f12f4ad285906784b275e11c7"
Jul 17 21:47:24.580894 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:24.580855    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v6kxc" event={"ID":"51e1534b-5606-4852-b4bc-4248d1d138f7","Type":"ContainerStarted","Data":"2db029aabeb9c51a8a75107052ac5c3fa91fe94511aeee539b27ab12d642f52c"}
Jul 17 21:47:27.557781 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.557725    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" podUID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" containerName="registry" containerID="cri-o://f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34" gracePeriod=30
Jul 17 21:47:27.596407 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.596374    2570 generic.go:356] "Generic (PLEG): container finished" podID="1616a665-1311-4a3f-a1e4-7289ffbc3994" containerID="653b7275e5377f94ccbbd1f06b451b4163398b1d2f0e9b16469b0f70679bb100" exitCode=0
Jul 17 21:47:27.596570 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.596424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x" event={"ID":"1616a665-1311-4a3f-a1e4-7289ffbc3994","Type":"ContainerDied","Data":"653b7275e5377f94ccbbd1f06b451b4163398b1d2f0e9b16469b0f70679bb100"}
Jul 17 21:47:27.596778 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.596765    2570 scope.go:117] "RemoveContainer" containerID="653b7275e5377f94ccbbd1f06b451b4163398b1d2f0e9b16469b0f70679bb100"
Jul 17 21:47:27.797717 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.797688    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:47:27.860190 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860190 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860144    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hznt\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860190 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860452 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860302    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860452 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860347    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860452 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860402    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860452 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860434    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860652 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860463    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") pod \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\" (UID: \"d4e9d99e-de6e-4e08-9332-10d05ba3a210\") "
Jul 17 21:47:27.860986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860931    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:47:27.860986 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.860962    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:47:27.862729 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.862690    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt" (OuterVolumeSpecName: "kube-api-access-9hznt") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "kube-api-access-9hznt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:27.863114 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.863085    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:47:27.863114 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.863116    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:27.863272 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.863235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:27.863272 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.863258    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:47:27.871471 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.871444    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4e9d99e-de6e-4e08-9332-10d05ba3a210" (UID: "d4e9d99e-de6e-4e08-9332-10d05ba3a210"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:47:27.961941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961908    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-image-registry-private-configuration\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.961941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961940    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4e9d99e-de6e-4e08-9332-10d05ba3a210-ca-trust-extracted\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.961941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961949    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-bound-sa-token\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.962222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961958    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-certificates\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.962222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961968    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-registry-tls\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.962222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961976    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4e9d99e-de6e-4e08-9332-10d05ba3a210-installation-pull-secrets\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.962222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961985    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hznt\" (UniqueName: \"kubernetes.io/projected/d4e9d99e-de6e-4e08-9332-10d05ba3a210-kube-api-access-9hznt\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:27.962222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:27.961992    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e9d99e-de6e-4e08-9332-10d05ba3a210-trusted-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:47:28.601947 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.601910    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mm97x" event={"ID":"1616a665-1311-4a3f-a1e4-7289ffbc3994","Type":"ContainerStarted","Data":"4d41df741e3832884ba9a2019c2c18f7e5d1c71d8b063a1fb901e87da3758663"}
Jul 17 21:47:28.603119 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.603094    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" containerID="f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34" exitCode=0
Jul 17 21:47:28.603198 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.603130    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd"
Jul 17 21:47:28.603198 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.603178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" event={"ID":"d4e9d99e-de6e-4e08-9332-10d05ba3a210","Type":"ContainerDied","Data":"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"}
Jul 17 21:47:28.603265 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.603217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d967fb88-4t9xd" event={"ID":"d4e9d99e-de6e-4e08-9332-10d05ba3a210","Type":"ContainerDied","Data":"82cc9d65af51e4d96b9f8e0a8e36553f7f0b4ee687afec097ff1c24617e45398"}
Jul 17 21:47:28.603265 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.603239    2570 scope.go:117] "RemoveContainer" containerID="f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"
Jul 17 21:47:28.611261 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.611245    2570 scope.go:117] "RemoveContainer" containerID="f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"
Jul 17 21:47:28.611566 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:47:28.611544    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34\": container with ID starting with f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34 not found: ID does not exist" containerID="f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"
Jul 17 21:47:28.611659 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.611577    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34"} err="failed to get container status \"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34\": rpc error: code = NotFound desc = could not find container \"f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34\": container with ID starting with f4826411b2aa27daf739c3f27484359f6f5129c9da419a91ae1f01f97b939f34 not found: ID does not exist"
Jul 17 21:47:28.631763 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.631736    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:47:28.637292 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:28.637266    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68d967fb88-4t9xd"]
Jul 17 21:47:30.007257 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:30.007224    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" path="/var/lib/kubelet/pods/d4e9d99e-de6e-4e08-9332-10d05ba3a210/volumes"
Jul 17 21:47:38.642580 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:38.642549    2570 generic.go:356] "Generic (PLEG): container finished" podID="26c90da4-e4d1-420a-88ab-4fb8b73da803" containerID="9630c1209d32a56dcf885c1317713db1a51daf8a8631f7b3c166fb326d558583" exitCode=0
Jul 17 21:47:38.643067 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:38.642601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4" event={"ID":"26c90da4-e4d1-420a-88ab-4fb8b73da803","Type":"ContainerDied","Data":"9630c1209d32a56dcf885c1317713db1a51daf8a8631f7b3c166fb326d558583"}
Jul 17 21:47:38.643067 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:38.642942    2570 scope.go:117] "RemoveContainer" containerID="9630c1209d32a56dcf885c1317713db1a51daf8a8631f7b3c166fb326d558583"
Jul 17 21:47:39.649027 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:47:39.648995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mvbp4" event={"ID":"26c90da4-e4d1-420a-88ab-4fb8b73da803","Type":"ContainerStarted","Data":"0289fceed0b022d6ac00c7bbcdaaf108dbc2f3213f95d0796f348d119e7fd9c8"}
Jul 17 21:49:27.214391 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.214351    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"]
Jul 17 21:49:27.214943 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.214741    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" containerName="registry"
Jul 17 21:49:27.214943 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.214757    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" containerName="registry"
Jul 17 21:49:27.214943 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.214827    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e9d99e-de6e-4e08-9332-10d05ba3a210" containerName="registry"
Jul 17 21:49:27.217663 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.217608    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.220055 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.220032    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fljqd\""
Jul 17 21:49:27.220163 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.220126    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 21:49:27.220163 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.220126    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 21:49:27.227456 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.227434    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"]
Jul 17 21:49:27.349033 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.348997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22phd\" (UniqueName: \"kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.349216 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.349067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.349216 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.349103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.450230 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.450195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22phd\" (UniqueName: \"kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.450432 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.450260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.450432 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.450290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.450673 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.450653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.450719 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.450696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.458525 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.458500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22phd\" (UniqueName: \"kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.526576 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.526489    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:27.660640 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:27.660584    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"]
Jul 17 21:49:27.664100 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:49:27.664063    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03365e31_f1ab_4bd0_b326_b747a4160d1f.slice/crio-742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e WatchSource:0}: Error finding container 742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e: Status 404 returned error can't find the container with id 742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e
Jul 17 21:49:28.019172 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:28.019139    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerStarted","Data":"742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e"}
Jul 17 21:49:29.879837 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.879804    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"]
Jul 17 21:49:29.883148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.883127    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.885541 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.885523    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 21:49:29.885541 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.885535    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 21:49:29.885735 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.885537    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 21:49:29.885735 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.885528    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 21:49:29.885735 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.885537    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 21:49:29.886590 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.886576    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 21:49:29.886674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.886578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 21:49:29.895200 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.895176    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"]
Jul 17 21:49:29.970845 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.970811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22n7q\" (UniqueName: \"kubernetes.io/projected/49b9f89d-c269-4c14-a843-b44740626baf-kube-api-access-22n7q\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.971032 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.970854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/49b9f89d-c269-4c14-a843-b44740626baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.971032 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.970924    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.971032 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.970944    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.971032 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.971018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:29.971232 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:29.971073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071517 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071484    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071517 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071788 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071788 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071788 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22n7q\" (UniqueName: \"kubernetes.io/projected/49b9f89d-c269-4c14-a843-b44740626baf-kube-api-access-22n7q\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.071788 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.071702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/49b9f89d-c269-4c14-a843-b44740626baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.072577 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.072549    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/49b9f89d-c269-4c14-a843-b44740626baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.074504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.074461    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.074605 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.074564    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-ca\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.074823 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.074800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.075096 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.075077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/49b9f89d-c269-4c14-a843-b44740626baf-hub\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.081061 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.081033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22n7q\" (UniqueName: \"kubernetes.io/projected/49b9f89d-c269-4c14-a843-b44740626baf-kube-api-access-22n7q\") pod \"cluster-proxy-proxy-agent-65d7bf778-2kwpt\" (UID: \"49b9f89d-c269-4c14-a843-b44740626baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.212702 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.212596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"
Jul 17 21:49:30.357952 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:30.357915    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt"]
Jul 17 21:49:30.360844 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:49:30.360817    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b9f89d_c269_4c14_a843_b44740626baf.slice/crio-91c7ff2be53c8ebfb6edfdfe8f487d21526feed670cdca28cd3b61c4b9c8cae4 WatchSource:0}: Error finding container 91c7ff2be53c8ebfb6edfdfe8f487d21526feed670cdca28cd3b61c4b9c8cae4: Status 404 returned error can't find the container with id 91c7ff2be53c8ebfb6edfdfe8f487d21526feed670cdca28cd3b61c4b9c8cae4
Jul 17 21:49:31.032315 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:31.032267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt" event={"ID":"49b9f89d-c269-4c14-a843-b44740626baf","Type":"ContainerStarted","Data":"91c7ff2be53c8ebfb6edfdfe8f487d21526feed670cdca28cd3b61c4b9c8cae4"}
Jul 17 21:49:36.055397 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:36.055363    2570 generic.go:356] "Generic (PLEG): container finished" podID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerID="e471f3c5e7ba00b0935f18a3f1cdef2a54ff04951e59ddef1a425cb9b948a514" exitCode=0
Jul 17 21:49:36.055878 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:36.055452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerDied","Data":"e471f3c5e7ba00b0935f18a3f1cdef2a54ff04951e59ddef1a425cb9b948a514"}
Jul 17 21:49:36.057167 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:36.057030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt" event={"ID":"49b9f89d-c269-4c14-a843-b44740626baf","Type":"ContainerStarted","Data":"9cfd644be4c8e6fb20630d1c4440b7230d0e66c1a3fb0ff93292f0bba736e4f4"}
Jul 17 21:49:37.063398 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:37.063362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt" event={"ID":"49b9f89d-c269-4c14-a843-b44740626baf","Type":"ContainerStarted","Data":"5e020afb972d3408549ac491259521f7725a00e3b9b56966352e6ff69a0f2a6b"}
Jul 17 21:49:37.063398 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:37.063406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt" event={"ID":"49b9f89d-c269-4c14-a843-b44740626baf","Type":"ContainerStarted","Data":"5e18b682b05fd13b912870d610960cd239d199028b574d9dcc753a56bba15756"}
Jul 17 21:49:37.082242 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:37.082193    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65d7bf778-2kwpt" podStartSLOduration=2.543523156 podStartE2EDuration="8.082173992s" totalImagesPullingTime="5.538650836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:49:37.081016581 +0000 UTC m=+245.559969141" watchObservedRunningTime="2026-07-17 21:49:37.082173992 +0000 UTC m=+245.561126548"
Jul 17 21:49:39.073098 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:39.073066    2570 generic.go:356] "Generic (PLEG): container finished" podID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerID="2339b3c4c4aa6e64419f42335b40a0a662377e94848dcca95d24f5f8a3079fe8" exitCode=0
Jul 17 21:49:39.073480 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:39.073124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerDied","Data":"2339b3c4c4aa6e64419f42335b40a0a662377e94848dcca95d24f5f8a3079fe8"}
Jul 17 21:49:46.103837 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:46.103805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerStarted","Data":"3788cc0fb0ce940b78f121e8fe7954e82c7c5de2e48bd2ddffc2565dfae5b4ac"}
Jul 17 21:49:46.124457 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:46.124405    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" podStartSLOduration=2.061780331 podStartE2EDuration="19.124390254s" totalImagesPullingTime="17.062609923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:49:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:49:46.122837196 +0000 UTC m=+254.601789752" watchObservedRunningTime="2026-07-17 21:49:46.124390254 +0000 UTC m=+254.603342809"
Jul 17 21:49:47.111804 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:47.111774    2570 generic.go:356] "Generic (PLEG): container finished" podID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerID="3788cc0fb0ce940b78f121e8fe7954e82c7c5de2e48bd2ddffc2565dfae5b4ac" exitCode=0
Jul 17 21:49:47.112183 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:47.111830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerDied","Data":"3788cc0fb0ce940b78f121e8fe7954e82c7c5de2e48bd2ddffc2565dfae5b4ac"}
Jul 17 21:49:48.240302 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.240275    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:49:48.324632 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.324590    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util\") pod \"03365e31-f1ab-4bd0-b326-b747a4160d1f\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") "
Jul 17 21:49:48.324801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.324674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22phd\" (UniqueName: \"kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd\") pod \"03365e31-f1ab-4bd0-b326-b747a4160d1f\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") "
Jul 17 21:49:48.324801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.324718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle\") pod \"03365e31-f1ab-4bd0-b326-b747a4160d1f\" (UID: \"03365e31-f1ab-4bd0-b326-b747a4160d1f\") "
Jul 17 21:49:48.325348 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.325310    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle" (OuterVolumeSpecName: "bundle") pod "03365e31-f1ab-4bd0-b326-b747a4160d1f" (UID: "03365e31-f1ab-4bd0-b326-b747a4160d1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:49:48.326934 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.326906    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd" (OuterVolumeSpecName: "kube-api-access-22phd") pod "03365e31-f1ab-4bd0-b326-b747a4160d1f" (UID: "03365e31-f1ab-4bd0-b326-b747a4160d1f"). InnerVolumeSpecName "kube-api-access-22phd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:49:48.329029 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.329005    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util" (OuterVolumeSpecName: "util") pod "03365e31-f1ab-4bd0-b326-b747a4160d1f" (UID: "03365e31-f1ab-4bd0-b326-b747a4160d1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:49:48.425285 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.425191    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:49:48.425285 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.425226    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22phd\" (UniqueName: \"kubernetes.io/projected/03365e31-f1ab-4bd0-b326-b747a4160d1f-kube-api-access-22phd\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:49:48.425285 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:48.425240    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03365e31-f1ab-4bd0-b326-b747a4160d1f-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:49:49.120774 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:49.120734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q" event={"ID":"03365e31-f1ab-4bd0-b326-b747a4160d1f","Type":"ContainerDied","Data":"742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e"}
Jul 17 21:49:49.120970 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:49.120791    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="742355f80be6ad93a1cf2ebfa07fdac3a07d4893c17031679cd43000fbf5440e"
Jul 17 21:49:49.120970 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:49:49.120743    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gc2q"
Jul 17 21:50:09.945807 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.945723    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"]
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.945984    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="util"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.945994    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="util"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.946007    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="extract"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.946013    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="extract"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.946020    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="pull"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.946025    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="pull"
Jul 17 21:50:09.946250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.946072    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="03365e31-f1ab-4bd0-b326-b747a4160d1f" containerName="extract"
Jul 17 21:50:09.950023 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.950003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:09.952479 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.952453    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 21:50:09.952479 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.952464    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 21:50:09.953135 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.953121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fljqd\""
Jul 17 21:50:09.959745 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.959722    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"]
Jul 17 21:50:09.982937 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.982903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:09.983100 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.982962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:09.983100 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:09.983027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsnx\" (UniqueName: \"kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.084373 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.084329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.084574 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.084384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsnx\" (UniqueName: \"kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.084574 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.084414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.084808 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.084790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.084885 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.084859    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.093255 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.093219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsnx\" (UniqueName: \"kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.259374 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.259286    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:10.401061 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:10.401036    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"]
Jul 17 21:50:10.403060 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:50:10.403036    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d8ab8f_eb79_46b1_86d9_36032f7e089a.slice/crio-083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec WatchSource:0}: Error finding container 083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec: Status 404 returned error can't find the container with id 083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec
Jul 17 21:50:11.203658 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:11.203555    2570 generic.go:356] "Generic (PLEG): container finished" podID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerID="b5d766fe482941982a318f8dae9e18ee4c5a941b5ee1bdde7b88b144c8b6c4b9" exitCode=0
Jul 17 21:50:11.203658 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:11.203633    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c" event={"ID":"35d8ab8f-eb79-46b1-86d9-36032f7e089a","Type":"ContainerDied","Data":"b5d766fe482941982a318f8dae9e18ee4c5a941b5ee1bdde7b88b144c8b6c4b9"}
Jul 17 21:50:11.204078 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:11.203673    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c" event={"ID":"35d8ab8f-eb79-46b1-86d9-36032f7e089a","Type":"ContainerStarted","Data":"083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec"}
Jul 17 21:50:15.220234 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:15.220200    2570 generic.go:356] "Generic (PLEG): container finished" podID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerID="4b86179ee2a1ef66d9443c2f184859e5b25d494b7824f1e626c41188b777de82" exitCode=0
Jul 17 21:50:15.220765 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:15.220233    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c" event={"ID":"35d8ab8f-eb79-46b1-86d9-36032f7e089a","Type":"ContainerDied","Data":"4b86179ee2a1ef66d9443c2f184859e5b25d494b7824f1e626c41188b777de82"}
Jul 17 21:50:16.225506 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:16.225471    2570 generic.go:356] "Generic (PLEG): container finished" podID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerID="3e7dd3968f71e5d6088d0c2c7fcc30be6375182deaac05ad78fa30ea2fec95e7" exitCode=0
Jul 17 21:50:16.225916 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:16.225562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c" event={"ID":"35d8ab8f-eb79-46b1-86d9-36032f7e089a","Type":"ContainerDied","Data":"3e7dd3968f71e5d6088d0c2c7fcc30be6375182deaac05ad78fa30ea2fec95e7"}
Jul 17 21:50:17.356442 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.356415    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:17.446451 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.446419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util\") pod \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") "
Jul 17 21:50:17.446451 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.446458    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle\") pod \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") "
Jul 17 21:50:17.446662 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.446497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fsnx\" (UniqueName: \"kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx\") pod \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\" (UID: \"35d8ab8f-eb79-46b1-86d9-36032f7e089a\") "
Jul 17 21:50:17.446905 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.446871    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle" (OuterVolumeSpecName: "bundle") pod "35d8ab8f-eb79-46b1-86d9-36032f7e089a" (UID: "35d8ab8f-eb79-46b1-86d9-36032f7e089a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:50:17.448690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.448667    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx" (OuterVolumeSpecName: "kube-api-access-4fsnx") pod "35d8ab8f-eb79-46b1-86d9-36032f7e089a" (UID: "35d8ab8f-eb79-46b1-86d9-36032f7e089a"). InnerVolumeSpecName "kube-api-access-4fsnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:50:17.451370 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.451350    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util" (OuterVolumeSpecName: "util") pod "35d8ab8f-eb79-46b1-86d9-36032f7e089a" (UID: "35d8ab8f-eb79-46b1-86d9-36032f7e089a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:50:17.546972 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.546941    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fsnx\" (UniqueName: \"kubernetes.io/projected/35d8ab8f-eb79-46b1-86d9-36032f7e089a-kube-api-access-4fsnx\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:17.546972 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.546973    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:17.547158 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:17.546982    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35d8ab8f-eb79-46b1-86d9-36032f7e089a-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:18.234277 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:18.234246    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c"
Jul 17 21:50:18.234469 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:18.234249    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh264c" event={"ID":"35d8ab8f-eb79-46b1-86d9-36032f7e089a","Type":"ContainerDied","Data":"083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec"}
Jul 17 21:50:18.234469 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:18.234371    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="083fe90ba04c318a02e24f4c693fbe0a4603afa912eac0416e903632a69f7cec"
Jul 17 21:50:22.570410 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570375    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"]
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570663    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="extract"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570674    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="extract"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570690    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="pull"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570696    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="pull"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570704    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="util"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570709    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="util"
Jul 17 21:50:22.570857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.570766    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d8ab8f-eb79-46b1-86d9-36032f7e089a" containerName="extract"
Jul 17 21:50:22.572270 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.572255    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.574403 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.574381    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 21:50:22.574403 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.574396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-w5shh\""
Jul 17 21:50:22.575139 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.575120    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:50:22.584320 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.584295    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"]
Jul 17 21:50:22.689198 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.689159    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f7e675-9112-4f4a-a744-8a8f7a65746f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.689198 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.689198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vtm\" (UniqueName: \"kubernetes.io/projected/d0f7e675-9112-4f4a-a744-8a8f7a65746f-kube-api-access-k5vtm\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.790490 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.790455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f7e675-9112-4f4a-a744-8a8f7a65746f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.790490 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.790493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vtm\" (UniqueName: \"kubernetes.io/projected/d0f7e675-9112-4f4a-a744-8a8f7a65746f-kube-api-access-k5vtm\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.790876 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.790858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0f7e675-9112-4f4a-a744-8a8f7a65746f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.798449 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.798424    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vtm\" (UniqueName: \"kubernetes.io/projected/d0f7e675-9112-4f4a-a744-8a8f7a65746f-kube-api-access-k5vtm\") pod \"openshift-lws-operator-fd8ccff4c-5fg9r\" (UID: \"d0f7e675-9112-4f4a-a744-8a8f7a65746f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:22.881395 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:22.881300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"
Jul 17 21:50:23.014276 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:23.014241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r"]
Jul 17 21:50:23.018020 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:50:23.017984    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f7e675_9112_4f4a_a744_8a8f7a65746f.slice/crio-e3fe1255d6391da7127c229857ec4826e3ef4519972c39d56fea21bca6827a9e WatchSource:0}: Error finding container e3fe1255d6391da7127c229857ec4826e3ef4519972c39d56fea21bca6827a9e: Status 404 returned error can't find the container with id e3fe1255d6391da7127c229857ec4826e3ef4519972c39d56fea21bca6827a9e
Jul 17 21:50:23.253577 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:23.253492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r" event={"ID":"d0f7e675-9112-4f4a-a744-8a8f7a65746f","Type":"ContainerStarted","Data":"e3fe1255d6391da7127c229857ec4826e3ef4519972c39d56fea21bca6827a9e"}
Jul 17 21:50:26.268698 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:26.268654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r" event={"ID":"d0f7e675-9112-4f4a-a744-8a8f7a65746f","Type":"ContainerStarted","Data":"7b09e1cfd8fb3d258ef4c02aa3acae97680e67a15a419981081017f66dc45d44"}
Jul 17 21:50:26.290941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:26.290873    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fg9r" podStartSLOduration=1.157069776 podStartE2EDuration="4.290856603s" totalImagesPullingTime="3.133786827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:50:26.289547309 +0000 UTC m=+294.768499866" watchObservedRunningTime="2026-07-17 21:50:26.290856603 +0000 UTC m=+294.769809159"
Jul 17 21:50:28.829223 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.829190    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"]
Jul 17 21:50:28.831516 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.831498    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:28.833843 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.833817    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 21:50:28.834630 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.834594    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 21:50:28.834744 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.834599    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fljqd\""
Jul 17 21:50:28.840544 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.840520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"]
Jul 17 21:50:28.941429 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.941396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:28.941662 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.941456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggssg\" (UniqueName: \"kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:28.941662 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:28.941537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.042920 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.042878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.043089 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.042946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggssg\" (UniqueName: \"kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.043089 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.042976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.043298 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.043279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.043335 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.043299    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.051970 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.051935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggssg\" (UniqueName: \"kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.140941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.140837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:29.285644 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:29.285558    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"]
Jul 17 21:50:29.287284 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:50:29.287261    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4981ef_8998_4450_8456_909bbbeb40e9.slice/crio-491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c WatchSource:0}: Error finding container 491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c: Status 404 returned error can't find the container with id 491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c
Jul 17 21:50:30.286658 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:30.286603    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerID="0ec45fa786b08d2a196563cdb133cd183b6e68c227fc39b868c6f7253899e4c0" exitCode=0
Jul 17 21:50:30.287059 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:30.286660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl" event={"ID":"cf4981ef-8998-4450-8456-909bbbeb40e9","Type":"ContainerDied","Data":"0ec45fa786b08d2a196563cdb133cd183b6e68c227fc39b868c6f7253899e4c0"}
Jul 17 21:50:30.287059 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:30.286715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl" event={"ID":"cf4981ef-8998-4450-8456-909bbbeb40e9","Type":"ContainerStarted","Data":"491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c"}
Jul 17 21:50:31.293067 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:31.293031    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerID="5d92a8498a738075f2dc77cde1b4e510e5e9fb18dea6f613aacfff59fbb913ee" exitCode=0
Jul 17 21:50:31.293452 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:31.293114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl" event={"ID":"cf4981ef-8998-4450-8456-909bbbeb40e9","Type":"ContainerDied","Data":"5d92a8498a738075f2dc77cde1b4e510e5e9fb18dea6f613aacfff59fbb913ee"}
Jul 17 21:50:31.918049 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:31.918020    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:50:31.920030 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:31.920010    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:50:31.928996 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:31.928977    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 21:50:32.299522 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:32.299490    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerID="7ac1c1dc67e029ef6a700a26d8f43fe69abd26e57cd29c40457fc90e67b74c62" exitCode=0
Jul 17 21:50:32.300932 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:32.299561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl" event={"ID":"cf4981ef-8998-4450-8456-909bbbeb40e9","Type":"ContainerDied","Data":"7ac1c1dc67e029ef6a700a26d8f43fe69abd26e57cd29c40457fc90e67b74c62"}
Jul 17 21:50:33.425784 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.425757    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:33.581660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.581534    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle\") pod \"cf4981ef-8998-4450-8456-909bbbeb40e9\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") "
Jul 17 21:50:33.581660 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.581607    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util\") pod \"cf4981ef-8998-4450-8456-909bbbeb40e9\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") "
Jul 17 21:50:33.581895 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.581700    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggssg\" (UniqueName: \"kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg\") pod \"cf4981ef-8998-4450-8456-909bbbeb40e9\" (UID: \"cf4981ef-8998-4450-8456-909bbbeb40e9\") "
Jul 17 21:50:33.582461 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.582430    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle" (OuterVolumeSpecName: "bundle") pod "cf4981ef-8998-4450-8456-909bbbeb40e9" (UID: "cf4981ef-8998-4450-8456-909bbbeb40e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:50:33.583965 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.583936    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg" (OuterVolumeSpecName: "kube-api-access-ggssg") pod "cf4981ef-8998-4450-8456-909bbbeb40e9" (UID: "cf4981ef-8998-4450-8456-909bbbeb40e9"). InnerVolumeSpecName "kube-api-access-ggssg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:50:33.590347 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.590302    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util" (OuterVolumeSpecName: "util") pod "cf4981ef-8998-4450-8456-909bbbeb40e9" (UID: "cf4981ef-8998-4450-8456-909bbbeb40e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:50:33.682637 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.682576    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:33.682637 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.682609    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf4981ef-8998-4450-8456-909bbbeb40e9-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:33.682834 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:33.682649    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggssg\" (UniqueName: \"kubernetes.io/projected/cf4981ef-8998-4450-8456-909bbbeb40e9-kube-api-access-ggssg\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:50:34.308941 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:34.308913    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl"
Jul 17 21:50:34.309100 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:34.308912    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcxhtl" event={"ID":"cf4981ef-8998-4450-8456-909bbbeb40e9","Type":"ContainerDied","Data":"491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c"}
Jul 17 21:50:34.309100 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:34.309033    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="491c85b9bd3aaf6c12fda74f203960aafd1452658aa792e8a7ec759518f9b08c"
Jul 17 21:50:46.060601 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060568    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"]
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060849    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="extract"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060860    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="extract"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060871    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="pull"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060876    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="pull"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060890    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="util"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060895    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="util"
Jul 17 21:50:46.061080 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.060940    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4981ef-8998-4450-8456-909bbbeb40e9" containerName="extract"
Jul 17 21:50:46.063717 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.063699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.071090 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.071073    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 21:50:46.072797 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.072762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 21:50:46.073749 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.073729    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rl47g\""
Jul 17 21:50:46.075876 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.075856    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 21:50:46.077393 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.077377    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 21:50:46.181636 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.181571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.181806 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.181690    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-manifests\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.181806 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.181752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.181806 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.181796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2htb\" (UniqueName: \"kubernetes.io/projected/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-kube-api-access-w2htb\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.181926 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.181824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-tmp\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.238713 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.238675    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"]
Jul 17 21:50:46.283256 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2htb\" (UniqueName: \"kubernetes.io/projected/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-kube-api-access-w2htb\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.283456 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-tmp\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.283456 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.283456 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-manifests\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.283650 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.283843 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.283824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-manifests\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.285911 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.285889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-tmp\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.286000 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.285971    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.286111 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.286092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.296850 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.296827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2htb\" (UniqueName: \"kubernetes.io/projected/949b7e7d-989f-4f5a-a358-4c89aefb7c0e-kube-api-access-w2htb\") pod \"opendatahub-operator-controller-manager-bff9999cf-hjpbs\" (UID: \"949b7e7d-989f-4f5a-a358-4c89aefb7c0e\") " pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.373485 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.373414    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:46.525575 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.525542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"]
Jul 17 21:50:46.529181 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:50:46.529156    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949b7e7d_989f_4f5a_a358_4c89aefb7c0e.slice/crio-536cdd3dc321d23f6febd97c96ef518aa834984164ce1c1a7df7e02cbf79e445 WatchSource:0}: Error finding container 536cdd3dc321d23f6febd97c96ef518aa834984164ce1c1a7df7e02cbf79e445: Status 404 returned error can't find the container with id 536cdd3dc321d23f6febd97c96ef518aa834984164ce1c1a7df7e02cbf79e445
Jul 17 21:50:46.531044 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:46.531026    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:50:47.366821 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:47.366783    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs" event={"ID":"949b7e7d-989f-4f5a-a358-4c89aefb7c0e","Type":"ContainerStarted","Data":"536cdd3dc321d23f6febd97c96ef518aa834984164ce1c1a7df7e02cbf79e445"}
Jul 17 21:50:50.381257 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:50.381219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs" event={"ID":"949b7e7d-989f-4f5a-a358-4c89aefb7c0e","Type":"ContainerStarted","Data":"d0a4d0c0b771b253540b8c5626251caaa4d7d970be5f45be7c429aba3515292b"}
Jul 17 21:50:51.388157 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:51.388122    2570 generic.go:356] "Generic (PLEG): container finished" podID="949b7e7d-989f-4f5a-a358-4c89aefb7c0e" containerID="d0a4d0c0b771b253540b8c5626251caaa4d7d970be5f45be7c429aba3515292b" exitCode=0
Jul 17 21:50:51.388797 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:51.388773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs" event={"ID":"949b7e7d-989f-4f5a-a358-4c89aefb7c0e","Type":"ContainerDied","Data":"d0a4d0c0b771b253540b8c5626251caaa4d7d970be5f45be7c429aba3515292b"}
Jul 17 21:50:52.395289 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:52.395255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs" event={"ID":"949b7e7d-989f-4f5a-a358-4c89aefb7c0e","Type":"ContainerStarted","Data":"1d77f3246ef45b3284dcf8a9c2c98bb694c85d35af20ce8740a8b682aaebda6b"}
Jul 17 21:50:52.395712 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:52.395391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:50:52.421386 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:50:52.421333    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs" podStartSLOduration=2.097191022 podStartE2EDuration="6.421315909s" totalImagesPullingTime="3.257999589s" totalInitContainerRuntime="1.066125298s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:50:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:50:52.419577803 +0000 UTC m=+320.898530385" watchObservedRunningTime="2026-07-17 21:50:52.421315909 +0000 UTC m=+320.900268464"
Jul 17 21:51:03.401719 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:03.401684    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bff9999cf-hjpbs"
Jul 17 21:51:06.510214 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.510177    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"]
Jul 17 21:51:06.514928 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.514901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.517644 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.517606    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzcqx\""
Jul 17 21:51:06.517779 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.517606    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 21:51:06.517779 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.517735    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 21:51:06.544358 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.544326    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"]
Jul 17 21:51:06.544688 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.544670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52x7\" (UniqueName: \"kubernetes.io/projected/b6802050-3109-4456-a133-5e2897a626dd-kube-api-access-w52x7\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.544819 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.544709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6802050-3109-4456-a133-5e2897a626dd-tls-certs\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.544819 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.544771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6802050-3109-4456-a133-5e2897a626dd-tmp\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.645822 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.645781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6802050-3109-4456-a133-5e2897a626dd-tmp\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.645992 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.645844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52x7\" (UniqueName: \"kubernetes.io/projected/b6802050-3109-4456-a133-5e2897a626dd-kube-api-access-w52x7\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.645992 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.645877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6802050-3109-4456-a133-5e2897a626dd-tls-certs\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.648248 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.648210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6802050-3109-4456-a133-5e2897a626dd-tmp\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.648382 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.648335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6802050-3109-4456-a133-5e2897a626dd-tls-certs\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.663303 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.663276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52x7\" (UniqueName: \"kubernetes.io/projected/b6802050-3109-4456-a133-5e2897a626dd-kube-api-access-w52x7\") pod \"kube-auth-proxy-85fdd95b7f-wmthq\" (UID: \"b6802050-3109-4456-a133-5e2897a626dd\") " pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.824434 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.824404    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"
Jul 17 21:51:06.989843 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:06.989805    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq"]
Jul 17 21:51:06.993122 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:51:06.993098    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6802050_3109_4456_a133_5e2897a626dd.slice/crio-7761cf7bc06aa5987b51cf29224110e92d022123f11de5034ae36b601891fa16 WatchSource:0}: Error finding container 7761cf7bc06aa5987b51cf29224110e92d022123f11de5034ae36b601891fa16: Status 404 returned error can't find the container with id 7761cf7bc06aa5987b51cf29224110e92d022123f11de5034ae36b601891fa16
Jul 17 21:51:07.460248 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.460211    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq" event={"ID":"b6802050-3109-4456-a133-5e2897a626dd","Type":"ContainerStarted","Data":"7761cf7bc06aa5987b51cf29224110e92d022123f11de5034ae36b601891fa16"}
Jul 17 21:51:07.905262 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.905227    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jgb2"]
Jul 17 21:51:07.907627 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.907583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:07.911350 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.911330    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 21:51:07.933131 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.933097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jgb2"]
Jul 17 21:51:07.954506 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.954471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wmtl\" (UniqueName: \"kubernetes.io/projected/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-kube-api-access-2wmtl\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:07.954726 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:07.954518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.055994 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.055955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wmtl\" (UniqueName: \"kubernetes.io/projected/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-kube-api-access-2wmtl\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.056180 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.056009    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.059360 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.059331    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.070748 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.070725    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wmtl\" (UniqueName: \"kubernetes.io/projected/5b088a83-7a41-4e0b-8bae-b83dc05a0ae0-kube-api-access-2wmtl\") pod \"model-serving-api-54d89bd5fc-4jgb2\" (UID: \"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.220178 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.220092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:08.383264 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.383173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jgb2"]
Jul 17 21:51:08.385736 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:51:08.385705    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b088a83_7a41_4e0b_8bae_b83dc05a0ae0.slice/crio-08c2013861e829e65397d7503769515f868eaa2b5a7f3f48dca88b4ba25b4285 WatchSource:0}: Error finding container 08c2013861e829e65397d7503769515f868eaa2b5a7f3f48dca88b4ba25b4285: Status 404 returned error can't find the container with id 08c2013861e829e65397d7503769515f868eaa2b5a7f3f48dca88b4ba25b4285
Jul 17 21:51:08.466298 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:08.466255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2" event={"ID":"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0","Type":"ContainerStarted","Data":"08c2013861e829e65397d7503769515f868eaa2b5a7f3f48dca88b4ba25b4285"}
Jul 17 21:51:10.478392 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:10.478350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq" event={"ID":"b6802050-3109-4456-a133-5e2897a626dd","Type":"ContainerStarted","Data":"d056bc18b63b56389310314333e34d9d09de430443a03369a781c0a05deff9d0"}
Jul 17 21:51:10.495580 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:10.495524    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85fdd95b7f-wmthq" podStartSLOduration=2.052010444 podStartE2EDuration="4.49550587s" totalImagesPullingTime="2.443495426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:51:10.493939879 +0000 UTC m=+338.972892435" watchObservedRunningTime="2026-07-17 21:51:10.49550587 +0000 UTC m=+338.974458425"
Jul 17 21:51:11.485103 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:11.485064    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2" event={"ID":"5b088a83-7a41-4e0b-8bae-b83dc05a0ae0","Type":"ContainerStarted","Data":"44902165695f067a2a4ec9106a89f3f9be8ef5ccd2e56ae70cec374e5a3f841f"}
Jul 17 21:51:11.485550 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:11.485294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:11.500896 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:11.500852    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2" podStartSLOduration=2.143497063 podStartE2EDuration="4.500837448s" totalImagesPullingTime="2.357340385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:51:11.500188837 +0000 UTC m=+339.979141394" watchObservedRunningTime="2026-07-17 21:51:11.500837448 +0000 UTC m=+339.979790004"
Jul 17 21:51:14.189936 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.189907    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"]
Jul 17 21:51:14.193097 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.193081    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.196255 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.196234    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 21:51:14.196375 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.196267    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 21:51:14.196375 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.196286    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mq6fg\""
Jul 17 21:51:14.196375 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.196274    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 21:51:14.202461 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.202439    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"]
Jul 17 21:51:14.305471 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.305436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-metrics-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.305471 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.305470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncfh\" (UniqueName: \"kubernetes.io/projected/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-kube-api-access-fncfh\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.305673 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.305541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.305673 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.305600    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-manager-config\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.406007 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.405968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.406175 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.406024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-manager-config\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.406175 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.406073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-metrics-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.406175 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.406111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncfh\" (UniqueName: \"kubernetes.io/projected/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-kube-api-access-fncfh\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.406710 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.406686    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-manager-config\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.408542 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.408522    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.408944 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.408925    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-metrics-cert\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.414882 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.414860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncfh\" (UniqueName: \"kubernetes.io/projected/28f7c021-4c32-45b7-b7bc-fe8eb9b665ab-kube-api-access-fncfh\") pod \"lws-controller-manager-68687b8cf-skzhz\" (UID: \"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab\") " pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.502069 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.501828    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:14.670139 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:14.670112    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"]
Jul 17 21:51:14.672590 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:51:14.672565    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f7c021_4c32_45b7_b7bc_fe8eb9b665ab.slice/crio-f118803fea7b0a35f5641c154d6fc7b2e4d2071acd6611bb5ee9a20f30fdfab2 WatchSource:0}: Error finding container f118803fea7b0a35f5641c154d6fc7b2e4d2071acd6611bb5ee9a20f30fdfab2: Status 404 returned error can't find the container with id f118803fea7b0a35f5641c154d6fc7b2e4d2071acd6611bb5ee9a20f30fdfab2
Jul 17 21:51:15.503281 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:15.503244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz" event={"ID":"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab","Type":"ContainerStarted","Data":"f118803fea7b0a35f5641c154d6fc7b2e4d2071acd6611bb5ee9a20f30fdfab2"}
Jul 17 21:51:17.514314 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:17.514283    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz" event={"ID":"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab","Type":"ContainerStarted","Data":"49a72106af6e70a389eee88f4f7daf1491f35bf27985f6c462ec9f47c4a47ca5"}
Jul 17 21:51:17.514801 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:17.514406    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:51:22.493464 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:22.493435    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4jgb2"
Jul 17 21:51:22.514725 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:22.514672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz" podStartSLOduration=6.420042421 podStartE2EDuration="8.514656082s" totalImagesPullingTime="2.094613661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:51:17.547268366 +0000 UTC m=+346.026220921" watchObservedRunningTime="2026-07-17 21:51:22.514656082 +0000 UTC m=+350.993608637"
Jul 17 21:51:28.521184 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:51:28.521101    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 21:52:23.356354 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.356313    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"]
Jul 17 21:52:23.361248 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.361206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.363711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.363689    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 21:52:23.364467 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.364440    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wlrl\""
Jul 17 21:52:23.364578 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.364466    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 21:52:23.367422 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.367395    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"]
Jul 17 21:52:23.469399 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.469364    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4v9g\" (UniqueName: \"kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.469399 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.469401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.469607 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.469431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.570421 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.570379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4v9g\" (UniqueName: \"kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.570421 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.570426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.570680 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.570458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.570880 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.570858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.570917 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.570866    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.579574 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.579545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4v9g\" (UniqueName: \"kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.671786 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.671700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:23.766925 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.766891    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"]
Jul 17 21:52:23.770582 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.770561    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.779565 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.779495    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"]
Jul 17 21:52:23.816402 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.816381    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"]
Jul 17 21:52:23.818563 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:52:23.818536    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27ae53a_3206_43a3_b33e_2bab98c46bd9.slice/crio-d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948 WatchSource:0}: Error finding container d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948: Status 404 returned error can't find the container with id d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948
Jul 17 21:52:23.874250 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.874225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.874356 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.874263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.874356 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.874291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zc4k\" (UniqueName: \"kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.975690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.975562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.975690 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.975654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zc4k\" (UniqueName: \"kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.975918 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.975763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.975980 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.975941    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.976086 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.976068    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:23.983543 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:23.983518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zc4k\" (UniqueName: \"kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:24.083161 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.083123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:24.159424 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.159390    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"]
Jul 17 21:52:24.163154 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.163132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.172935 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.172875    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"]
Jul 17 21:52:24.176962 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.176934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.177083 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.177004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669ps\" (UniqueName: \"kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.177083 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.177054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.217558 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.217536    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"]
Jul 17 21:52:24.219533 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:52:24.219511    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dcfb62_473d_4cdb_bde3_19be6f4f114e.slice/crio-b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca WatchSource:0}: Error finding container b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca: Status 404 returned error can't find the container with id b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca
Jul 17 21:52:24.277735 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.277710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.277857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.277758    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669ps\" (UniqueName: \"kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.277857 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.277788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.278134 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.278119    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.278204 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.278179    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.286202 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.286180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669ps\" (UniqueName: \"kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.476444 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.476405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:24.567597 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.567565    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"]
Jul 17 21:52:24.571947 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.571926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.581123 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.579198    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"]
Jul 17 21:52:24.614146 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.614023    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"]
Jul 17 21:52:24.681552 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.681527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.681689 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.681565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7bz\" (UniqueName: \"kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.681689 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.681588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.782398 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.782305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.782398 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.782360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7bz\" (UniqueName: \"kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.782398 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.782399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.782754 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.782732    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.782821 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.782801    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.791082 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.791052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7bz\" (UniqueName: \"kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:24.816061 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.816027    2570 generic.go:356] "Generic (PLEG): container finished" podID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerID="dbde53a9a86326fe4d9f1cfce85de11bd31e4d0f1e6bff5454c55be94c1835e9" exitCode=0
Jul 17 21:52:24.816191 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.816114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn" event={"ID":"08dcfb62-473d-4cdb-bde3-19be6f4f114e","Type":"ContainerDied","Data":"dbde53a9a86326fe4d9f1cfce85de11bd31e4d0f1e6bff5454c55be94c1835e9"}
Jul 17 21:52:24.816191 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.816168    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn" event={"ID":"08dcfb62-473d-4cdb-bde3-19be6f4f114e","Type":"ContainerStarted","Data":"b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca"}
Jul 17 21:52:24.817666 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.817643    2570 generic.go:356] "Generic (PLEG): container finished" podID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerID="81e0ad33a4505b15372c41e5512c0f5167e23665146ec411c459f13f021a53e7" exitCode=0
Jul 17 21:52:24.817796 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.817669    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq" event={"ID":"24f44a34-6f8f-4836-bd24-2a98a586041f","Type":"ContainerDied","Data":"81e0ad33a4505b15372c41e5512c0f5167e23665146ec411c459f13f021a53e7"}
Jul 17 21:52:24.817796 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.817705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq" event={"ID":"24f44a34-6f8f-4836-bd24-2a98a586041f","Type":"ContainerStarted","Data":"1c8654e37b89e28909005c71fbeb4ef7c6462c95f8459f4a55adac9bc195fd5f"}
Jul 17 21:52:24.819269 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.819249    2570 generic.go:356] "Generic (PLEG): container finished" podID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerID="b8c08ace81683cae48f4dae574e3ad6fc74e91e88dcb414ad9b2d3a5e36dd69c" exitCode=0
Jul 17 21:52:24.819359 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.819293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm" event={"ID":"a27ae53a-3206-43a3-b33e-2bab98c46bd9","Type":"ContainerDied","Data":"b8c08ace81683cae48f4dae574e3ad6fc74e91e88dcb414ad9b2d3a5e36dd69c"}
Jul 17 21:52:24.819359 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.819323    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm" event={"ID":"a27ae53a-3206-43a3-b33e-2bab98c46bd9","Type":"ContainerStarted","Data":"d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948"}
Jul 17 21:52:24.895949 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:24.895921    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:25.028923 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.028895    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"]
Jul 17 21:52:25.030001 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:52:25.029975    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83f8729_d4a6_4552_89ac_26e0fd5225f3.slice/crio-1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a WatchSource:0}: Error finding container 1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a: Status 404 returned error can't find the container with id 1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a
Jul 17 21:52:25.826633 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.826579    2570 generic.go:356] "Generic (PLEG): container finished" podID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerID="55cbbf87e6c17390ab3d7d4e4963b1f7eb1cc267f8edffd2717a0669e9a9fb06" exitCode=0
Jul 17 21:52:25.827053 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.826709    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq" event={"ID":"24f44a34-6f8f-4836-bd24-2a98a586041f","Type":"ContainerDied","Data":"55cbbf87e6c17390ab3d7d4e4963b1f7eb1cc267f8edffd2717a0669e9a9fb06"}
Jul 17 21:52:25.828265 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.828247    2570 generic.go:356] "Generic (PLEG): container finished" podID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerID="a9cbe139529cdd603b14e88c5e5d2a2aed89a06448378fff0c59d68370e7a302" exitCode=0
Jul 17 21:52:25.828356 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.828335    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8" event={"ID":"e83f8729-d4a6-4552-89ac-26e0fd5225f3","Type":"ContainerDied","Data":"a9cbe139529cdd603b14e88c5e5d2a2aed89a06448378fff0c59d68370e7a302"}
Jul 17 21:52:25.828416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.828389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8" event={"ID":"e83f8729-d4a6-4552-89ac-26e0fd5225f3","Type":"ContainerStarted","Data":"1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a"}
Jul 17 21:52:25.830146 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.830124    2570 generic.go:356] "Generic (PLEG): container finished" podID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerID="749bd732b3bad2f272e9717010a1ca8d846e068a57275b1304e5616a1e04a0ad" exitCode=0
Jul 17 21:52:25.830248 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:25.830205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm" event={"ID":"a27ae53a-3206-43a3-b33e-2bab98c46bd9","Type":"ContainerDied","Data":"749bd732b3bad2f272e9717010a1ca8d846e068a57275b1304e5616a1e04a0ad"}
Jul 17 21:52:26.837203 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.837166    2570 generic.go:356] "Generic (PLEG): container finished" podID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerID="1d7413b1528c1e9b520daac9f8070b1a503fc07f51190f639a0cca62ffe67a44" exitCode=0
Jul 17 21:52:26.837656 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.837250    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq" event={"ID":"24f44a34-6f8f-4836-bd24-2a98a586041f","Type":"ContainerDied","Data":"1d7413b1528c1e9b520daac9f8070b1a503fc07f51190f639a0cca62ffe67a44"}
Jul 17 21:52:26.838938 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.838916    2570 generic.go:356] "Generic (PLEG): container finished" podID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerID="5d1416ff11a157d660e1c9466ed51fd68d680d02800ff6b622d863861a4fb211" exitCode=0
Jul 17 21:52:26.839041 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.838978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8" event={"ID":"e83f8729-d4a6-4552-89ac-26e0fd5225f3","Type":"ContainerDied","Data":"5d1416ff11a157d660e1c9466ed51fd68d680d02800ff6b622d863861a4fb211"}
Jul 17 21:52:26.841131 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.841110    2570 generic.go:356] "Generic (PLEG): container finished" podID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerID="49569862e775271a1d9d5a31449b298ede869ffa1112d3874547cee3b1875128" exitCode=0
Jul 17 21:52:26.841235 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.841190    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm" event={"ID":"a27ae53a-3206-43a3-b33e-2bab98c46bd9","Type":"ContainerDied","Data":"49569862e775271a1d9d5a31449b298ede869ffa1112d3874547cee3b1875128"}
Jul 17 21:52:26.842864 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.842838    2570 generic.go:356] "Generic (PLEG): container finished" podID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerID="9f107ef471629b69c5574969bc653e3861bf2eb033c9d58e43369aa5ed4fad59" exitCode=0
Jul 17 21:52:26.842935 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:26.842864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn" event={"ID":"08dcfb62-473d-4cdb-bde3-19be6f4f114e","Type":"ContainerDied","Data":"9f107ef471629b69c5574969bc653e3861bf2eb033c9d58e43369aa5ed4fad59"}
Jul 17 21:52:27.850309 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:27.850270    2570 generic.go:356] "Generic (PLEG): container finished" podID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerID="f9ca94d9edb1cc3375a3581ed08ec80d673335fc838698f809cb28ef54d9da63" exitCode=0
Jul 17 21:52:27.850763 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:27.850360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn" event={"ID":"08dcfb62-473d-4cdb-bde3-19be6f4f114e","Type":"ContainerDied","Data":"f9ca94d9edb1cc3375a3581ed08ec80d673335fc838698f809cb28ef54d9da63"}
Jul 17 21:52:27.852527 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:27.852506    2570 generic.go:356] "Generic (PLEG): container finished" podID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerID="4c7964774096abbf7c625021bae4bdb7e73b93e35d10ab70d99ae141572c3219" exitCode=0
Jul 17 21:52:27.852597 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:27.852571    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8" event={"ID":"e83f8729-d4a6-4552-89ac-26e0fd5225f3","Type":"ContainerDied","Data":"4c7964774096abbf7c625021bae4bdb7e73b93e35d10ab70d99ae141572c3219"}
Jul 17 21:52:28.002804 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.002777    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:28.005798 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.005775    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:28.110760 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110671    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle\") pod \"24f44a34-6f8f-4836-bd24-2a98a586041f\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") "
Jul 17 21:52:28.110760 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110716    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle\") pod \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") "
Jul 17 21:52:28.110990 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110767    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util\") pod \"24f44a34-6f8f-4836-bd24-2a98a586041f\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") "
Jul 17 21:52:28.110990 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110810    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4v9g\" (UniqueName: \"kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g\") pod \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") "
Jul 17 21:52:28.110990 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110846    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-669ps\" (UniqueName: \"kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps\") pod \"24f44a34-6f8f-4836-bd24-2a98a586041f\" (UID: \"24f44a34-6f8f-4836-bd24-2a98a586041f\") "
Jul 17 21:52:28.110990 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.110878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util\") pod \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\" (UID: \"a27ae53a-3206-43a3-b33e-2bab98c46bd9\") "
Jul 17 21:52:28.111390 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.111356    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle" (OuterVolumeSpecName: "bundle") pod "24f44a34-6f8f-4836-bd24-2a98a586041f" (UID: "24f44a34-6f8f-4836-bd24-2a98a586041f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:28.111495 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.111467    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle" (OuterVolumeSpecName: "bundle") pod "a27ae53a-3206-43a3-b33e-2bab98c46bd9" (UID: "a27ae53a-3206-43a3-b33e-2bab98c46bd9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:28.113719 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.113689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps" (OuterVolumeSpecName: "kube-api-access-669ps") pod "24f44a34-6f8f-4836-bd24-2a98a586041f" (UID: "24f44a34-6f8f-4836-bd24-2a98a586041f"). InnerVolumeSpecName "kube-api-access-669ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:52:28.113798 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.113741    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g" (OuterVolumeSpecName: "kube-api-access-g4v9g") pod "a27ae53a-3206-43a3-b33e-2bab98c46bd9" (UID: "a27ae53a-3206-43a3-b33e-2bab98c46bd9"). InnerVolumeSpecName "kube-api-access-g4v9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:52:28.117062 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.117036    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util" (OuterVolumeSpecName: "util") pod "24f44a34-6f8f-4836-bd24-2a98a586041f" (UID: "24f44a34-6f8f-4836-bd24-2a98a586041f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:28.117767 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.117744    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util" (OuterVolumeSpecName: "util") pod "a27ae53a-3206-43a3-b33e-2bab98c46bd9" (UID: "a27ae53a-3206-43a3-b33e-2bab98c46bd9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:28.212504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212465    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.212504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212498    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.212504 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212509    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4v9g\" (UniqueName: \"kubernetes.io/projected/a27ae53a-3206-43a3-b33e-2bab98c46bd9-kube-api-access-g4v9g\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.212777 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212519    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-669ps\" (UniqueName: \"kubernetes.io/projected/24f44a34-6f8f-4836-bd24-2a98a586041f-kube-api-access-669ps\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.212777 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212529    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a27ae53a-3206-43a3-b33e-2bab98c46bd9-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.212777 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.212537    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24f44a34-6f8f-4836-bd24-2a98a586041f-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:28.859234 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.859207    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq"
Jul 17 21:52:28.859686 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.859206    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq" event={"ID":"24f44a34-6f8f-4836-bd24-2a98a586041f","Type":"ContainerDied","Data":"1c8654e37b89e28909005c71fbeb4ef7c6462c95f8459f4a55adac9bc195fd5f"}
Jul 17 21:52:28.859686 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.859355    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c8654e37b89e28909005c71fbeb4ef7c6462c95f8459f4a55adac9bc195fd5f"
Jul 17 21:52:28.861179 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.861158    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm"
Jul 17 21:52:28.861291 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.861175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm" event={"ID":"a27ae53a-3206-43a3-b33e-2bab98c46bd9","Type":"ContainerDied","Data":"d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948"}
Jul 17 21:52:28.861291 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.861216    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2c8dd9a3bb63cbb652984ac43eb46ac8ea9f186ff052e2470b4dd3dbf6ac948"
Jul 17 21:52:28.998551 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:28.998526    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:29.019316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.019290    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle\") pod \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") "
Jul 17 21:52:29.019453 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.019393    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zc4k\" (UniqueName: \"kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k\") pod \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") "
Jul 17 21:52:29.019453 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.019420    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util\") pod \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\" (UID: \"08dcfb62-473d-4cdb-bde3-19be6f4f114e\") "
Jul 17 21:52:29.020062 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.020019    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle" (OuterVolumeSpecName: "bundle") pod "08dcfb62-473d-4cdb-bde3-19be6f4f114e" (UID: "08dcfb62-473d-4cdb-bde3-19be6f4f114e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:29.022379 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.022351    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k" (OuterVolumeSpecName: "kube-api-access-2zc4k") pod "08dcfb62-473d-4cdb-bde3-19be6f4f114e" (UID: "08dcfb62-473d-4cdb-bde3-19be6f4f114e"). InnerVolumeSpecName "kube-api-access-2zc4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:52:29.025627 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.025593    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util" (OuterVolumeSpecName: "util") pod "08dcfb62-473d-4cdb-bde3-19be6f4f114e" (UID: "08dcfb62-473d-4cdb-bde3-19be6f4f114e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:29.039956 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.039930    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:52:29.120018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.119935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util\") pod \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") "
Jul 17 21:52:29.120018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.119986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle\") pod \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") "
Jul 17 21:52:29.120018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.120022    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt7bz\" (UniqueName: \"kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz\") pod \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\" (UID: \"e83f8729-d4a6-4552-89ac-26e0fd5225f3\") "
Jul 17 21:52:29.120222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.120182    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zc4k\" (UniqueName: \"kubernetes.io/projected/08dcfb62-473d-4cdb-bde3-19be6f4f114e-kube-api-access-2zc4k\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.120222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.120193    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.120222 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.120201    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08dcfb62-473d-4cdb-bde3-19be6f4f114e-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.120762 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.120686    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle" (OuterVolumeSpecName: "bundle") pod "e83f8729-d4a6-4552-89ac-26e0fd5225f3" (UID: "e83f8729-d4a6-4552-89ac-26e0fd5225f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:29.122251 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.122228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz" (OuterVolumeSpecName: "kube-api-access-zt7bz") pod "e83f8729-d4a6-4552-89ac-26e0fd5225f3" (UID: "e83f8729-d4a6-4552-89ac-26e0fd5225f3"). InnerVolumeSpecName "kube-api-access-zt7bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:52:29.125283 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.125265    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util" (OuterVolumeSpecName: "util") pod "e83f8729-d4a6-4552-89ac-26e0fd5225f3" (UID: "e83f8729-d4a6-4552-89ac-26e0fd5225f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:52:29.220906 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.220861    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-util\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.220906 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.220902    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e83f8729-d4a6-4552-89ac-26e0fd5225f3-bundle\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.220906 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.220911    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt7bz\" (UniqueName: \"kubernetes.io/projected/e83f8729-d4a6-4552-89ac-26e0fd5225f3-kube-api-access-zt7bz\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:52:29.867975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.867944    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn"
Jul 17 21:52:29.867975 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.867957    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn" event={"ID":"08dcfb62-473d-4cdb-bde3-19be6f4f114e","Type":"ContainerDied","Data":"b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca"}
Jul 17 21:52:29.868449 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.868000    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0db790bb5d2fdca06fccbf8099a616732444f17316e86f7f8bca146500abeca"
Jul 17 21:52:29.869723 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.869695    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8" event={"ID":"e83f8729-d4a6-4552-89ac-26e0fd5225f3","Type":"ContainerDied","Data":"1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a"}
Jul 17 21:52:29.869848 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.869747    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fe4124e01fc3b50abc4701e897ee727e2888d19a906da1db9f4a7c3b2bee78a"
Jul 17 21:52:29.869848 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:52:29.869704    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8"
Jul 17 21:54:13.694209 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694172    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694511    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694523    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694530    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694537    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694549    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694559    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694567    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694574    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694583    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694588    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="extract"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694594    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694599    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694606    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694627    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694643    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694650    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694660    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694666    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="util"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694673    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694678    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="pull"
Jul 17 21:54:13.694674 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694686    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="util"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694691    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="util"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694697    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="extract"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694702    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="extract"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694763    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f44a34-6f8f-4836-bd24-2a98a586041f" containerName="extract"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694770    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27ae53a-3206-43a3-b33e-2bab98c46bd9" containerName="extract"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694775    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e83f8729-d4a6-4552-89ac-26e0fd5225f3" containerName="extract"
Jul 17 21:54:13.695275 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.694780    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="08dcfb62-473d-4cdb-bde3-19be6f4f114e" containerName="extract"
Jul 17 21:54:13.697816 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.697801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:13.700274 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.700249    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 21:54:13.701054 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.701034    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jh7cr\""
Jul 17 21:54:13.701148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.701075    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 21:54:13.704994 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.704974    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:13.743075 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.743041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn8t\" (UniqueName: \"kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t\") pod \"authorino-58cd955675-nvkhs\" (UID: \"fdffa042-bc76-45a6-8a32-8071e291c15b\") " pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:13.806459 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.806427    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:13.809645 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.809608    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:13.818069 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.818044    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:13.844201 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.844166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn8t\" (UniqueName: \"kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t\") pod \"authorino-58cd955675-nvkhs\" (UID: \"fdffa042-bc76-45a6-8a32-8071e291c15b\") " pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:13.844356 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.844219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcxvp\" (UniqueName: \"kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp\") pod \"authorino-75d556bd77-692ss\" (UID: \"5e488401-6dcb-46f8-a316-3843d1b6805b\") " pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:13.852041 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.852007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn8t\" (UniqueName: \"kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t\") pod \"authorino-58cd955675-nvkhs\" (UID: \"fdffa042-bc76-45a6-8a32-8071e291c15b\") " pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:13.945501 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.945403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcxvp\" (UniqueName: \"kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp\") pod \"authorino-75d556bd77-692ss\" (UID: \"5e488401-6dcb-46f8-a316-3843d1b6805b\") " pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:13.954922 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:13.954892    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcxvp\" (UniqueName: \"kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp\") pod \"authorino-75d556bd77-692ss\" (UID: \"5e488401-6dcb-46f8-a316-3843d1b6805b\") " pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:14.007707 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.007667    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:14.118966 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.118937    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:14.136736 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.136708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:14.138354 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:54:14.138331    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdffa042_bc76_45a6_8a32_8071e291c15b.slice/crio-6cbf1c1bafbbad18109316cb3fd80667386e661baed1e8b2de78a1c154d8437f WatchSource:0}: Error finding container 6cbf1c1bafbbad18109316cb3fd80667386e661baed1e8b2de78a1c154d8437f: Status 404 returned error can't find the container with id 6cbf1c1bafbbad18109316cb3fd80667386e661baed1e8b2de78a1c154d8437f
Jul 17 21:54:14.250454 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.250431    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:14.252424 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:54:14.252399    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e488401_6dcb_46f8_a316_3843d1b6805b.slice/crio-274bf93380641729c4e126116345e70969503be5d8ba68be237f748c47c60fcd WatchSource:0}: Error finding container 274bf93380641729c4e126116345e70969503be5d8ba68be237f748c47c60fcd: Status 404 returned error can't find the container with id 274bf93380641729c4e126116345e70969503be5d8ba68be237f748c47c60fcd
Jul 17 21:54:14.356682 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.356646    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-692ss" event={"ID":"5e488401-6dcb-46f8-a316-3843d1b6805b","Type":"ContainerStarted","Data":"274bf93380641729c4e126116345e70969503be5d8ba68be237f748c47c60fcd"}
Jul 17 21:54:14.357806 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:14.357780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nvkhs" event={"ID":"fdffa042-bc76-45a6-8a32-8071e291c15b","Type":"ContainerStarted","Data":"6cbf1c1bafbbad18109316cb3fd80667386e661baed1e8b2de78a1c154d8437f"}
Jul 17 21:54:18.384283 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:18.384247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nvkhs" event={"ID":"fdffa042-bc76-45a6-8a32-8071e291c15b","Type":"ContainerStarted","Data":"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"}
Jul 17 21:54:18.385764 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:18.385740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-692ss" event={"ID":"5e488401-6dcb-46f8-a316-3843d1b6805b","Type":"ContainerStarted","Data":"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"}
Jul 17 21:54:18.399174 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:18.399129    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-nvkhs" podStartSLOduration=1.831921836 podStartE2EDuration="5.399113695s" totalImagesPullingTime="3.567191859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:54:18.398127529 +0000 UTC m=+526.877080086" watchObservedRunningTime="2026-07-17 21:54:18.399113695 +0000 UTC m=+526.878066250"
Jul 17 21:54:18.412945 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:18.412882    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-692ss" podStartSLOduration=1.9489916269999998 podStartE2EDuration="5.412861512s" totalImagesPullingTime="3.463869885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:54:18.411207709 +0000 UTC m=+526.890160267" watchObservedRunningTime="2026-07-17 21:54:18.412861512 +0000 UTC m=+526.891814073"
Jul 17 21:54:18.435299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:18.435260    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:20.395570 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:20.395528    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-nvkhs" podUID="fdffa042-bc76-45a6-8a32-8071e291c15b" containerName="authorino" containerID="cri-o://62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c" gracePeriod=30
Jul 17 21:54:20.636233 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:20.636202    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:20.701809 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:20.701725    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvn8t\" (UniqueName: \"kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t\") pod \"fdffa042-bc76-45a6-8a32-8071e291c15b\" (UID: \"fdffa042-bc76-45a6-8a32-8071e291c15b\") "
Jul 17 21:54:20.703999 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:20.703967    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t" (OuterVolumeSpecName: "kube-api-access-qvn8t") pod "fdffa042-bc76-45a6-8a32-8071e291c15b" (UID: "fdffa042-bc76-45a6-8a32-8071e291c15b"). InnerVolumeSpecName "kube-api-access-qvn8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:54:20.802563 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:20.802522    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvn8t\" (UniqueName: \"kubernetes.io/projected/fdffa042-bc76-45a6-8a32-8071e291c15b-kube-api-access-qvn8t\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:54:21.400882 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.400849    2570 generic.go:356] "Generic (PLEG): container finished" podID="fdffa042-bc76-45a6-8a32-8071e291c15b" containerID="62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c" exitCode=0
Jul 17 21:54:21.401330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.400890    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nvkhs"
Jul 17 21:54:21.401330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.400933    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nvkhs" event={"ID":"fdffa042-bc76-45a6-8a32-8071e291c15b","Type":"ContainerDied","Data":"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"}
Jul 17 21:54:21.401330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.400975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nvkhs" event={"ID":"fdffa042-bc76-45a6-8a32-8071e291c15b","Type":"ContainerDied","Data":"6cbf1c1bafbbad18109316cb3fd80667386e661baed1e8b2de78a1c154d8437f"}
Jul 17 21:54:21.401330 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.400992    2570 scope.go:117] "RemoveContainer" containerID="62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"
Jul 17 21:54:21.410053 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.410035    2570 scope.go:117] "RemoveContainer" containerID="62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"
Jul 17 21:54:21.410319 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:54:21.410301    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c\": container with ID starting with 62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c not found: ID does not exist" containerID="62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"
Jul 17 21:54:21.410361 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.410329    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c"} err="failed to get container status \"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c\": rpc error: code = NotFound desc = could not find container \"62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c\": container with ID starting with 62a2395160b0753cd89c34dd84049bf6e246fc90fda26281afec46036a7ffd8c not found: ID does not exist"
Jul 17 21:54:21.421344 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.421320    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:21.424422 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:21.424403    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-nvkhs"]
Jul 17 21:54:22.008159 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:22.008124    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdffa042-bc76-45a6-8a32-8071e291c15b" path="/var/lib/kubelet/pods/fdffa042-bc76-45a6-8a32-8071e291c15b/volumes"
Jul 17 21:54:42.792993 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.792954    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5gxs"]
Jul 17 21:54:42.793409 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.793280    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdffa042-bc76-45a6-8a32-8071e291c15b" containerName="authorino"
Jul 17 21:54:42.793409 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.793292    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdffa042-bc76-45a6-8a32-8071e291c15b" containerName="authorino"
Jul 17 21:54:42.793409 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.793359    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdffa042-bc76-45a6-8a32-8071e291c15b" containerName="authorino"
Jul 17 21:54:42.797652 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.797633    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:42.802896 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.802867    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5gxs"]
Jul 17 21:54:42.882201 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.882146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9lx\" (UniqueName: \"kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx\") pod \"authorino-5d4b67c446-j5gxs\" (UID: \"89c08784-c093-4aa4-81a7-041e6760c530\") " pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:42.972224 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.972194    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5gxs"]
Jul 17 21:54:42.977805 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:54:42.977714    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ht9lx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-j5gxs" podUID="89c08784-c093-4aa4-81a7-041e6760c530"
Jul 17 21:54:42.982725 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.982701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9lx\" (UniqueName: \"kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx\") pod \"authorino-5d4b67c446-j5gxs\" (UID: \"89c08784-c093-4aa4-81a7-041e6760c530\") " pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:42.998537 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.998500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-nfdxw"]
Jul 17 21:54:42.999960 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:42.999930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9lx\" (UniqueName: \"kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx\") pod \"authorino-5d4b67c446-j5gxs\" (UID: \"89c08784-c093-4aa4-81a7-041e6760c530\") " pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:43.005448 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.005419    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.007893 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.007873    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 21:54:43.010850 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.010827    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-nfdxw"]
Jul 17 21:54:43.048843 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.048752    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nfdxw"]
Jul 17 21:54:43.049031 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:54:43.049009    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2gsrd tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-2gsrd tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-nfdxw" podUID="fcf3dd5f-a58d-4f00-9373-73b6f358063a"
Jul 17 21:54:43.075771 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.075740    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:54:43.077942 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.077926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.086210 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.086189    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:54:43.183588 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.183554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gsrd\" (UniqueName: \"kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.183825 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.183678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.183825 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.183704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmw9w\" (UniqueName: \"kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.183825 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.183732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.284489 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.284440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gsrd\" (UniqueName: \"kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.284706 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.284529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.284706 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.284556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmw9w\" (UniqueName: \"kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.284706 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.284583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.287193 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.287166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.287323 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.287303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.292225 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.292200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmw9w\" (UniqueName: \"kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w\") pod \"authorino-778744f548-k7bmh\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") " pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.292459 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.292438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gsrd\" (UniqueName: \"kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd\") pod \"authorino-76877994-nfdxw\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") " pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.386608 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.386522    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:54:43.504149 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.504122    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.504355 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.504127    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:43.510974 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.510951    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:43.513367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.513349    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:43.524926 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.524898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:54:43.528531 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:54:43.528503    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2468ae57_c357_448d_bb1a_e6c80615ac9b.slice/crio-b081134c15fc0b2fca2af9c536f82bcc4c3ff64f6615279cd6190a7426c132d1 WatchSource:0}: Error finding container b081134c15fc0b2fca2af9c536f82bcc4c3ff64f6615279cd6190a7426c132d1: Status 404 returned error can't find the container with id b081134c15fc0b2fca2af9c536f82bcc4c3ff64f6615279cd6190a7426c132d1
Jul 17 21:54:43.688138 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.688050    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht9lx\" (UniqueName: \"kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx\") pod \"89c08784-c093-4aa4-81a7-041e6760c530\" (UID: \"89c08784-c093-4aa4-81a7-041e6760c530\") "
Jul 17 21:54:43.688138 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.688113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert\") pod \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") "
Jul 17 21:54:43.688382 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.688187    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gsrd\" (UniqueName: \"kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd\") pod \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\" (UID: \"fcf3dd5f-a58d-4f00-9373-73b6f358063a\") "
Jul 17 21:54:43.690372 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.690338    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fcf3dd5f-a58d-4f00-9373-73b6f358063a" (UID: "fcf3dd5f-a58d-4f00-9373-73b6f358063a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:54:43.690493 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.690374    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd" (OuterVolumeSpecName: "kube-api-access-2gsrd") pod "fcf3dd5f-a58d-4f00-9373-73b6f358063a" (UID: "fcf3dd5f-a58d-4f00-9373-73b6f358063a"). InnerVolumeSpecName "kube-api-access-2gsrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:54:43.690493 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.690377    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx" (OuterVolumeSpecName: "kube-api-access-ht9lx") pod "89c08784-c093-4aa4-81a7-041e6760c530" (UID: "89c08784-c093-4aa4-81a7-041e6760c530"). InnerVolumeSpecName "kube-api-access-ht9lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:54:43.789711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.789671    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gsrd\" (UniqueName: \"kubernetes.io/projected/fcf3dd5f-a58d-4f00-9373-73b6f358063a-kube-api-access-2gsrd\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:54:43.789711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.789703    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht9lx\" (UniqueName: \"kubernetes.io/projected/89c08784-c093-4aa4-81a7-041e6760c530-kube-api-access-ht9lx\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:54:43.789711 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:43.789713    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fcf3dd5f-a58d-4f00-9373-73b6f358063a-tls-cert\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:54:44.510491 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.510458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778744f548-k7bmh" event={"ID":"2468ae57-c357-448d-bb1a-e6c80615ac9b","Type":"ContainerStarted","Data":"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"}
Jul 17 21:54:44.510491 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.510483    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j5gxs"
Jul 17 21:54:44.510491 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.510499    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778744f548-k7bmh" event={"ID":"2468ae57-c357-448d-bb1a-e6c80615ac9b","Type":"ContainerStarted","Data":"b081134c15fc0b2fca2af9c536f82bcc4c3ff64f6615279cd6190a7426c132d1"}
Jul 17 21:54:44.511033 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.510744    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nfdxw"
Jul 17 21:54:44.526579 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.526527    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-778744f548-k7bmh" podStartSLOduration=1.24817558 podStartE2EDuration="1.52651155s" totalImagesPullingTime="278.33597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:54:44.524741202 +0000 UTC m=+553.003693759" watchObservedRunningTime="2026-07-17 21:54:44.52651155 +0000 UTC m=+553.005464106"
Jul 17 21:54:44.554326 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.554293    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:44.554496 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.554472    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-692ss" podUID="5e488401-6dcb-46f8-a316-3843d1b6805b" containerName="authorino" containerID="cri-o://d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84" gracePeriod=30
Jul 17 21:54:44.561505 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.561463    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nfdxw"]
Jul 17 21:54:44.569989 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.569961    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-nfdxw"]
Jul 17 21:54:44.590435 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.590408    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5gxs"]
Jul 17 21:54:44.592177 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.592152    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j5gxs"]
Jul 17 21:54:44.796127 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.796105    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:44.901119 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.900543    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcxvp\" (UniqueName: \"kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp\") pod \"5e488401-6dcb-46f8-a316-3843d1b6805b\" (UID: \"5e488401-6dcb-46f8-a316-3843d1b6805b\") "
Jul 17 21:54:44.907583 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:44.907544    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp" (OuterVolumeSpecName: "kube-api-access-hcxvp") pod "5e488401-6dcb-46f8-a316-3843d1b6805b" (UID: "5e488401-6dcb-46f8-a316-3843d1b6805b"). InnerVolumeSpecName "kube-api-access-hcxvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:54:45.003930 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.003888    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcxvp\" (UniqueName: \"kubernetes.io/projected/5e488401-6dcb-46f8-a316-3843d1b6805b-kube-api-access-hcxvp\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:54:45.515727 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.515688    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e488401-6dcb-46f8-a316-3843d1b6805b" containerID="d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84" exitCode=0
Jul 17 21:54:45.516148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.515739    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-692ss"
Jul 17 21:54:45.516148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.515771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-692ss" event={"ID":"5e488401-6dcb-46f8-a316-3843d1b6805b","Type":"ContainerDied","Data":"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"}
Jul 17 21:54:45.516148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.515813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-692ss" event={"ID":"5e488401-6dcb-46f8-a316-3843d1b6805b","Type":"ContainerDied","Data":"274bf93380641729c4e126116345e70969503be5d8ba68be237f748c47c60fcd"}
Jul 17 21:54:45.516148 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.515834    2570 scope.go:117] "RemoveContainer" containerID="d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"
Jul 17 21:54:45.524200 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.524184    2570 scope.go:117] "RemoveContainer" containerID="d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"
Jul 17 21:54:45.524464 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:54:45.524444    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84\": container with ID starting with d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84 not found: ID does not exist" containerID="d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"
Jul 17 21:54:45.524509 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.524473    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84"} err="failed to get container status \"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84\": rpc error: code = NotFound desc = could not find container \"d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84\": container with ID starting with d017961edeadc25926730bd167cabf04af93d1bc61cbe2330f63196305af1b84 not found: ID does not exist"
Jul 17 21:54:45.535429 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.535406    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:45.541348 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:45.541328    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-692ss"]
Jul 17 21:54:46.008562 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:46.008527    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e488401-6dcb-46f8-a316-3843d1b6805b" path="/var/lib/kubelet/pods/5e488401-6dcb-46f8-a316-3843d1b6805b/volumes"
Jul 17 21:54:46.008874 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:46.008861    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89c08784-c093-4aa4-81a7-041e6760c530" path="/var/lib/kubelet/pods/89c08784-c093-4aa4-81a7-041e6760c530/volumes"
Jul 17 21:54:46.009075 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:54:46.009064    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf3dd5f-a58d-4f00-9373-73b6f358063a" path="/var/lib/kubelet/pods/fcf3dd5f-a58d-4f00-9373-73b6f358063a/volumes"
Jul 17 21:55:31.955850 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:31.955820    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:55:31.956525 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:31.956508    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 21:55:47.929733 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.929695    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"]
Jul 17 21:55:47.931062 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.930011    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e488401-6dcb-46f8-a316-3843d1b6805b" containerName="authorino"
Jul 17 21:55:47.931062 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.930022    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e488401-6dcb-46f8-a316-3843d1b6805b" containerName="authorino"
Jul 17 21:55:47.931062 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.930115    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e488401-6dcb-46f8-a316-3843d1b6805b" containerName="authorino"
Jul 17 21:55:47.932166 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.932151    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:47.934594 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.934576    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 21:55:47.935337 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.935322    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 21:55:47.935432 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.935346    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7nlsc\""
Jul 17 21:55:47.935517 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.935502    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 17 21:55:47.944718 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:47.944696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"]
Jul 17 21:55:48.018054 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a37baea9-e8e8-4d5f-8ac2-303064e91866-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.018230 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018069    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.018230 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018132    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.018230 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/a37baea9-e8e8-4d5f-8ac2-303064e91866-kube-api-access-mgmbk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.018230 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.018379 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.018224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119536 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/a37baea9-e8e8-4d5f-8ac2-303064e91866-kube-api-access-mgmbk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a37baea9-e8e8-4d5f-8ac2-303064e91866-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.119738 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119733    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.120019 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.119997    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.120082 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.120028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.120082 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.120052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.122151 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.122133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a37baea9-e8e8-4d5f-8ac2-303064e91866-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.122418 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.122397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a37baea9-e8e8-4d5f-8ac2-303064e91866-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.127410 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.127387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/a37baea9-e8e8-4d5f-8ac2-303064e91866-kube-api-access-mgmbk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-29c7b\" (UID: \"a37baea9-e8e8-4d5f-8ac2-303064e91866\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.242362 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.242281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:48.376331 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.376306    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"]
Jul 17 21:55:48.378658 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:55:48.378603    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37baea9_e8e8_4d5f_8ac2_303064e91866.slice/crio-36b72289a811bf6415e8303064ee7e7971b30dfb0bbc43385fc4c1b69cdbaef5 WatchSource:0}: Error finding container 36b72289a811bf6415e8303064ee7e7971b30dfb0bbc43385fc4c1b69cdbaef5: Status 404 returned error can't find the container with id 36b72289a811bf6415e8303064ee7e7971b30dfb0bbc43385fc4c1b69cdbaef5
Jul 17 21:55:48.379919 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.379901    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:55:48.817890 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:48.817854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b" event={"ID":"a37baea9-e8e8-4d5f-8ac2-303064e91866","Type":"ContainerStarted","Data":"36b72289a811bf6415e8303064ee7e7971b30dfb0bbc43385fc4c1b69cdbaef5"}
Jul 17 21:55:49.826581 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:49.826548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b" event={"ID":"a37baea9-e8e8-4d5f-8ac2-303064e91866","Type":"ContainerStarted","Data":"6280e7a32482119fa41015fc9b96fcf445e7db65b8614e39fdefd6ccb116f575"}
Jul 17 21:55:49.843774 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:49.843726    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b" podStartSLOduration=1.840238265 podStartE2EDuration="2.84371045s" totalImagesPullingTime="1.003472185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:55:49.841587738 +0000 UTC m=+618.320540295" watchObservedRunningTime="2026-07-17 21:55:49.84371045 +0000 UTC m=+618.322663006"
Jul 17 21:55:58.243457 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:58.243375    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:58.243457 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:58.243439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:58.256223 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:58.256197    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:55:58.879683 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:55:58.879640    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-29c7b"
Jul 17 21:56:29.504497 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.504460    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"]
Jul 17 21:56:29.507978 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.507959    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.510373 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.510353    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 21:56:29.518584 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.518564    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"]
Jul 17 21:56:29.568420 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.568606 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.568606 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.568606 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxq2\" (UniqueName: \"kubernetes.io/projected/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-kube-api-access-8vxq2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.568606 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.568793 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.568641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669367 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669647 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxq2\" (UniqueName: \"kubernetes.io/projected/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-kube-api-access-8vxq2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669647 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669647 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669452    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669647 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669794    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669867 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669848    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.669957 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.669884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.671912 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.671888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.672150 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.672134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.678201 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.678181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxq2\" (UniqueName: \"kubernetes.io/projected/cd5952d5-aa25-4c56-86ac-28fef0b7e74a-kube-api-access-8vxq2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dqpnj\" (UID: \"cd5952d5-aa25-4c56-86ac-28fef0b7e74a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.818412 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.818387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:29.953179 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:29.953154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"]
Jul 17 21:56:29.955225 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:56:29.955197    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5952d5_aa25_4c56_86ac_28fef0b7e74a.slice/crio-2a3fd0db912d56aa16f8b0d0a3293fd9e00f2261306052bb0da9ca2dcdbbed26 WatchSource:0}: Error finding container 2a3fd0db912d56aa16f8b0d0a3293fd9e00f2261306052bb0da9ca2dcdbbed26: Status 404 returned error can't find the container with id 2a3fd0db912d56aa16f8b0d0a3293fd9e00f2261306052bb0da9ca2dcdbbed26
Jul 17 21:56:30.019870 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:30.019835    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj" event={"ID":"cd5952d5-aa25-4c56-86ac-28fef0b7e74a","Type":"ContainerStarted","Data":"2a3fd0db912d56aa16f8b0d0a3293fd9e00f2261306052bb0da9ca2dcdbbed26"}
Jul 17 21:56:31.027477 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:31.027443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj" event={"ID":"cd5952d5-aa25-4c56-86ac-28fef0b7e74a","Type":"ContainerStarted","Data":"be383e923575673743cfd214391393716f83d062053c04e04744c5d16de5b4d7"}
Jul 17 21:56:31.045663 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:31.045587    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj" podStartSLOduration=1.848998616 podStartE2EDuration="2.045569952s" totalImagesPullingTime="196.571336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:56:31.044186926 +0000 UTC m=+659.523139483" watchObservedRunningTime="2026-07-17 21:56:31.045569952 +0000 UTC m=+659.524522507"
Jul 17 21:56:38.613416 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.613383    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"]
Jul 17 21:56:38.617789 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.617759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.621688 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.621663    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 21:56:38.629685 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.629663    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"]
Jul 17 21:56:38.751214 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.751214 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.751474 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.751474 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.751474 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7616d580-de1b-4c83-8989-7fd447367969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.751474 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.751409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ndq\" (UniqueName: \"kubernetes.io/projected/7616d580-de1b-4c83-8989-7fd447367969-kube-api-access-68ndq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7616d580-de1b-4c83-8989-7fd447367969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852299 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68ndq\" (UniqueName: \"kubernetes.io/projected/7616d580-de1b-4c83-8989-7fd447367969-kube-api-access-68ndq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852514 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852514 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852514 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852514 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.852921 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.853018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.853018 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.852972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.854825 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.854803    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7616d580-de1b-4c83-8989-7fd447367969-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.854940 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.854899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7616d580-de1b-4c83-8989-7fd447367969-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.860523 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.860494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ndq\" (UniqueName: \"kubernetes.io/projected/7616d580-de1b-4c83-8989-7fd447367969-kube-api-access-68ndq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw\" (UID: \"7616d580-de1b-4c83-8989-7fd447367969\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:38.929085 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:38.928992    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:39.065962 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:39.065938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"]
Jul 17 21:56:39.067788 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:56:39.067755    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7616d580_de1b_4c83_8989_7fd447367969.slice/crio-2d5fedaf0882f39722597bb78ed4805b3cb56dff027ec6a9fbe53bea55d91b66 WatchSource:0}: Error finding container 2d5fedaf0882f39722597bb78ed4805b3cb56dff027ec6a9fbe53bea55d91b66: Status 404 returned error can't find the container with id 2d5fedaf0882f39722597bb78ed4805b3cb56dff027ec6a9fbe53bea55d91b66
Jul 17 21:56:39.819316 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:39.819285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:39.819783 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:39.819392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:39.832057 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:39.832029    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:40.073084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:40.072984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw" event={"ID":"7616d580-de1b-4c83-8989-7fd447367969","Type":"ContainerStarted","Data":"7eb5ef4f1f20731b5d19bac26e3302b09cc38c3404296aadbb1c8a5941c8ff16"}
Jul 17 21:56:40.073084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:40.073034    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw" event={"ID":"7616d580-de1b-4c83-8989-7fd447367969","Type":"ContainerStarted","Data":"2d5fedaf0882f39722597bb78ed4805b3cb56dff027ec6a9fbe53bea55d91b66"}
Jul 17 21:56:40.084904 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:40.084866    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dqpnj"
Jul 17 21:56:40.090544 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:40.090500    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw" podStartSLOduration=1.929989066 podStartE2EDuration="2.090485889s" totalImagesPullingTime="160.496823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:56:40.088684037 +0000 UTC m=+668.567636593" watchObservedRunningTime="2026-07-17 21:56:40.090485889 +0000 UTC m=+668.569438445"
Jul 17 21:56:48.930022 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:48.929981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:48.930538 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:48.930048    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:48.942955 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:48.942924    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:56:49.129140 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:56:49.129111    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw"
Jul 17 21:57:57.053957 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.053919    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6784666db5-752l9"]
Jul 17 21:57:57.057078 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.057061    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.064465 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.064443    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6784666db5-752l9"]
Jul 17 21:57:57.125434 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.125398    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brxcf\" (UniqueName: \"kubernetes.io/projected/d2fac992-39b4-4565-89a8-09c5bd681bf4-kube-api-access-brxcf\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.125638 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.125477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2fac992-39b4-4565-89a8-09c5bd681bf4-tls-cert\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.227029 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.226992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brxcf\" (UniqueName: \"kubernetes.io/projected/d2fac992-39b4-4565-89a8-09c5bd681bf4-kube-api-access-brxcf\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.227217 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.227057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2fac992-39b4-4565-89a8-09c5bd681bf4-tls-cert\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.229726 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.229696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2fac992-39b4-4565-89a8-09c5bd681bf4-tls-cert\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.235243 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.235213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brxcf\" (UniqueName: \"kubernetes.io/projected/d2fac992-39b4-4565-89a8-09c5bd681bf4-kube-api-access-brxcf\") pod \"authorino-6784666db5-752l9\" (UID: \"d2fac992-39b4-4565-89a8-09c5bd681bf4\") " pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.367197 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.367125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6784666db5-752l9"
Jul 17 21:57:57.527549 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:57.527520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6784666db5-752l9"]
Jul 17 21:57:57.529915 ip-10-0-131-4 kubenswrapper[2570]: W0717 21:57:57.529876    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2fac992_39b4_4565_89a8_09c5bd681bf4.slice/crio-47c7fc63008e43b2bf5faef529d0e76d6bfdc7f1d7f716c039b05829b01f515f WatchSource:0}: Error finding container 47c7fc63008e43b2bf5faef529d0e76d6bfdc7f1d7f716c039b05829b01f515f: Status 404 returned error can't find the container with id 47c7fc63008e43b2bf5faef529d0e76d6bfdc7f1d7f716c039b05829b01f515f
Jul 17 21:57:58.472331 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.472287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6784666db5-752l9" event={"ID":"d2fac992-39b4-4565-89a8-09c5bd681bf4","Type":"ContainerStarted","Data":"7c00b03995883cc6cdd69ce03c2cb59cc596791b2377e27cc5c42923752afe1d"}
Jul 17 21:57:58.472824 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.472341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6784666db5-752l9" event={"ID":"d2fac992-39b4-4565-89a8-09c5bd681bf4","Type":"ContainerStarted","Data":"47c7fc63008e43b2bf5faef529d0e76d6bfdc7f1d7f716c039b05829b01f515f"}
Jul 17 21:57:58.492318 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.492234    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6784666db5-752l9" podStartSLOduration=0.998121153 podStartE2EDuration="1.492213028s" totalImagesPullingTime="494.091875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:57:58.491029583 +0000 UTC m=+746.969982139" watchObservedRunningTime="2026-07-17 21:57:58.492213028 +0000 UTC m=+746.971165587"
Jul 17 21:57:58.536084 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.536049    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:57:58.536528 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.536498    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-778744f548-k7bmh" podUID="2468ae57-c357-448d-bb1a-e6c80615ac9b" containerName="authorino" containerID="cri-o://ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34" gracePeriod=30
Jul 17 21:57:58.799253 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.799226    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:57:58.843840 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.843810    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmw9w\" (UniqueName: \"kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w\") pod \"2468ae57-c357-448d-bb1a-e6c80615ac9b\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") "
Jul 17 21:57:58.844034 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.843947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert\") pod \"2468ae57-c357-448d-bb1a-e6c80615ac9b\" (UID: \"2468ae57-c357-448d-bb1a-e6c80615ac9b\") "
Jul 17 21:57:58.846097 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.846062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w" (OuterVolumeSpecName: "kube-api-access-hmw9w") pod "2468ae57-c357-448d-bb1a-e6c80615ac9b" (UID: "2468ae57-c357-448d-bb1a-e6c80615ac9b"). InnerVolumeSpecName "kube-api-access-hmw9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:57:58.854994 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.854967    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2468ae57-c357-448d-bb1a-e6c80615ac9b" (UID: "2468ae57-c357-448d-bb1a-e6c80615ac9b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:57:58.946680 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.946645    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2468ae57-c357-448d-bb1a-e6c80615ac9b-tls-cert\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:57:58.946680 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:58.946672    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmw9w\" (UniqueName: \"kubernetes.io/projected/2468ae57-c357-448d-bb1a-e6c80615ac9b-kube-api-access-hmw9w\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 21:57:59.479498 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.479460    2570 generic.go:356] "Generic (PLEG): container finished" podID="2468ae57-c357-448d-bb1a-e6c80615ac9b" containerID="ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34" exitCode=0
Jul 17 21:57:59.479963 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.479509    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778744f548-k7bmh"
Jul 17 21:57:59.479963 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.479557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778744f548-k7bmh" event={"ID":"2468ae57-c357-448d-bb1a-e6c80615ac9b","Type":"ContainerDied","Data":"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"}
Jul 17 21:57:59.479963 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.479608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778744f548-k7bmh" event={"ID":"2468ae57-c357-448d-bb1a-e6c80615ac9b","Type":"ContainerDied","Data":"b081134c15fc0b2fca2af9c536f82bcc4c3ff64f6615279cd6190a7426c132d1"}
Jul 17 21:57:59.479963 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.479673    2570 scope.go:117] "RemoveContainer" containerID="ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"
Jul 17 21:57:59.489539 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.489513    2570 scope.go:117] "RemoveContainer" containerID="ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"
Jul 17 21:57:59.489905 ip-10-0-131-4 kubenswrapper[2570]: E0717 21:57:59.489887    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34\": container with ID starting with ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34 not found: ID does not exist" containerID="ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"
Jul 17 21:57:59.489958 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.489918    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34"} err="failed to get container status \"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34\": rpc error: code = NotFound desc = could not find container \"ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34\": container with ID starting with ac110a629054dbf16dfe90746d5452beebc73c4d8e9ecde19301b7c79f270a34 not found: ID does not exist"
Jul 17 21:57:59.500488 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.500458    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:57:59.506573 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:57:59.506543    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-778744f548-k7bmh"]
Jul 17 21:58:00.009068 ip-10-0-131-4 kubenswrapper[2570]: I0717 21:58:00.009036    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2468ae57-c357-448d-bb1a-e6c80615ac9b" path="/var/lib/kubelet/pods/2468ae57-c357-448d-bb1a-e6c80615ac9b/volumes"
Jul 17 22:00:31.988956 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:00:31.988866    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:00:31.991080 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:00:31.991057    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:04:36.456605 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:36.456571    2570 generic.go:356] "Generic (PLEG): container finished" podID="28f7c021-4c32-45b7-b7bc-fe8eb9b665ab" containerID="49a72106af6e70a389eee88f4f7daf1491f35bf27985f6c462ec9f47c4a47ca5" exitCode=1
Jul 17 22:04:36.457049 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:36.456640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz" event={"ID":"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab","Type":"ContainerDied","Data":"49a72106af6e70a389eee88f4f7daf1491f35bf27985f6c462ec9f47c4a47ca5"}
Jul 17 22:04:36.457049 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:36.456978    2570 scope.go:117] "RemoveContainer" containerID="49a72106af6e70a389eee88f4f7daf1491f35bf27985f6c462ec9f47c4a47ca5"
Jul 17 22:04:37.463444 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:37.463412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz" event={"ID":"28f7c021-4c32-45b7-b7bc-fe8eb9b665ab","Type":"ContainerStarted","Data":"34cceea3fc3f6d05ac75a6a0751e380a1991bab3364c54e55f2673690c782faf"}
Jul 17 22:04:37.463885 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:37.463638    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 22:04:48.472176 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:04:48.472143    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68687b8cf-skzhz"
Jul 17 22:05:32.024155 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:05:32.024122    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:05:32.026569 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:05:32.026548    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:10:32.058438 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:10:32.058406    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:10:32.064778 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:10:32.064755    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:15:32.092248 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:15:32.092219    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:15:32.099719 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:15:32.099698    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:20:32.124050 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:20:32.123990    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:20:32.133726 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:20:32.133701    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:25:32.163164 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:25:32.163139    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:25:32.170861 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:25:32.170833    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:30:00.262442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.262395    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:30:00.262920 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.262729    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2468ae57-c357-448d-bb1a-e6c80615ac9b" containerName="authorino"
Jul 17 22:30:00.262920 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.262740    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2468ae57-c357-448d-bb1a-e6c80615ac9b" containerName="authorino"
Jul 17 22:30:00.262920 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.262806    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2468ae57-c357-448d-bb1a-e6c80615ac9b" containerName="authorino"
Jul 17 22:30:00.265809 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.265792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.269309 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.269282    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-895e50b8\"/\"e2e-lifecycle-model-895e50b8-kserve-self-signed-certs\""
Jul 17 22:30:00.269442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.269334    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-895e50b8\"/\"default-dockercfg-v7kpb\""
Jul 17 22:30:00.269442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.269291    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-895e50b8\"/\"openshift-service-ca.crt\""
Jul 17 22:30:00.269442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.269379    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-895e50b8\"/\"kube-root-ca.crt\""
Jul 17 22:30:00.280835 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.280811    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:30:00.400250 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400208    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.400440 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b7nw\" (UniqueName: \"kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.400440 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400370    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.400440 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.400562 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.400562 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.400481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501290 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501290 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501546 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501546 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501546 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501546 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b7nw\" (UniqueName: \"kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501832 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501806    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501879 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.501918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.501870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.503790 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.503765    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.504023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.504003    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.523968 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.523903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b7nw\" (UniqueName: \"kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw\") pod \"e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") " pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.574593 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.574549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:00.717000 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.716967    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:30:00.719295 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:30:00.719268    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33ae7eaa_9348_4326_99a9_f6e4fb1530db.slice/crio-083daf5ebd858a9be019ac11bc60abf0c8b988648c7a9ddc79dfc7290747d125 WatchSource:0}: Error finding container 083daf5ebd858a9be019ac11bc60abf0c8b988648c7a9ddc79dfc7290747d125: Status 404 returned error can't find the container with id 083daf5ebd858a9be019ac11bc60abf0c8b988648c7a9ddc79dfc7290747d125
Jul 17 22:30:00.994394 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.994356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" event={"ID":"33ae7eaa-9348-4326-99a9-f6e4fb1530db","Type":"ContainerStarted","Data":"e9e1f797a1cdb7f4b6102f44c7133034f3b0a66aec4233b0495e117777ba114e"}
Jul 17 22:30:00.994394 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:00.994398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" event={"ID":"33ae7eaa-9348-4326-99a9-f6e4fb1530db","Type":"ContainerStarted","Data":"083daf5ebd858a9be019ac11bc60abf0c8b988648c7a9ddc79dfc7290747d125"}
Jul 17 22:30:10.574981 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:10.574938    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:10.574981 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:10.574989    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:10.587493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:10.587466    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:10.603909 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:10.603842    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" podStartSLOduration=10.603825378 podStartE2EDuration="10.603825378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:30:01.016496319 +0000 UTC m=+2669.495448875" watchObservedRunningTime="2026-07-17 22:30:10.603825378 +0000 UTC m=+2679.082777933"
Jul 17 22:30:11.054521 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:11.054482    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:32.204089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:32.204015    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:30:32.211425 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:32.211391    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:30:42.121065 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:42.121022    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:30:57.141856 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.141790    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" podUID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" containerName="main" containerID="cri-o://e9e1f797a1cdb7f4b6102f44c7133034f3b0a66aec4233b0495e117777ba114e" gracePeriod=45
Jul 17 22:30:57.273865 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.273811    2570 generic.go:356] "Generic (PLEG): container finished" podID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" containerID="e9e1f797a1cdb7f4b6102f44c7133034f3b0a66aec4233b0495e117777ba114e" exitCode=0
Jul 17 22:30:57.274058 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.273874    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" event={"ID":"33ae7eaa-9348-4326-99a9-f6e4fb1530db","Type":"ContainerDied","Data":"e9e1f797a1cdb7f4b6102f44c7133034f3b0a66aec4233b0495e117777ba114e"}
Jul 17 22:30:57.385585 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.385561    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:57.473982 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.473888    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.473982 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.473929    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.474208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474017    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.474208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474038    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.474208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b7nw\" (UniqueName: \"kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.474208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474121    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs\") pod \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\" (UID: \"33ae7eaa-9348-4326-99a9-f6e4fb1530db\") "
Jul 17 22:30:57.474380 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474205    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache" (OuterVolumeSpecName: "model-cache") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:30:57.474380 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home" (OuterVolumeSpecName: "home") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:30:57.474380 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474361    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:30:57.474525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474466    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:57.474525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474479    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:57.474525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.474488    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:57.476230 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.476211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm" (OuterVolumeSpecName: "dshm") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:30:57.476326 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.476299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw" (OuterVolumeSpecName: "kube-api-access-9b7nw") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "kube-api-access-9b7nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:30:57.476423 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.476367    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33ae7eaa-9348-4326-99a9-f6e4fb1530db" (UID: "33ae7eaa-9348-4326-99a9-f6e4fb1530db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:30:57.575458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.575413    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ae7eaa-9348-4326-99a9-f6e4fb1530db-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:57.575458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.575449    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33ae7eaa-9348-4326-99a9-f6e4fb1530db-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:57.575458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:57.575458    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b7nw\" (UniqueName: \"kubernetes.io/projected/33ae7eaa-9348-4326-99a9-f6e4fb1530db-kube-api-access-9b7nw\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:30:58.280354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:58.280262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5" event={"ID":"33ae7eaa-9348-4326-99a9-f6e4fb1530db","Type":"ContainerDied","Data":"083daf5ebd858a9be019ac11bc60abf0c8b988648c7a9ddc79dfc7290747d125"}
Jul 17 22:30:58.280354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:58.280290    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"
Jul 17 22:30:58.280354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:58.280320    2570 scope.go:117] "RemoveContainer" containerID="e9e1f797a1cdb7f4b6102f44c7133034f3b0a66aec4233b0495e117777ba114e"
Jul 17 22:30:58.297267 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:58.297242    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:30:58.304782 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:30:58.304749    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-895e50b8/e2e-lifecycle-model-895e50b8-kserve-88df54c47-94hv5"]
Jul 17 22:31:00.008912 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:31:00.008875    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" path="/var/lib/kubelet/pods/33ae7eaa-9348-4326-99a9-f6e4fb1530db/volumes"
Jul 17 22:32:45.571561 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.571527    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:32:45.572070 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.571891    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" containerName="main"
Jul 17 22:32:45.572070 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.571903    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" containerName="main"
Jul 17 22:32:45.572070 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.571969    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ae7eaa-9348-4326-99a9-f6e4fb1530db" containerName="main"
Jul 17 22:32:45.574703 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.574685    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.579774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.579752    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-11aecf\"/\"kube-root-ca.crt\""
Jul 17 22:32:45.579774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.579762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-11aecf\"/\"test-model-11aecf-kserve-self-signed-certs\""
Jul 17 22:32:45.579934 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.579787    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-11aecf\"/\"openshift-service-ca.crt\""
Jul 17 22:32:45.580465 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.580445    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-11aecf\"/\"default-dockercfg-6xw52\""
Jul 17 22:32:45.605347 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.605313    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:32:45.716636 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.716811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.716811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.716811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.716811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.716811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.716764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdct\" (UniqueName: \"kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817754 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdct\" (UniqueName: \"kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.817932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.817881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.818187 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.818127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.818241 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.818195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.818241 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.818222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.820302 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.820279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.820545 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.820529    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.830347 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.830291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdct\" (UniqueName: \"kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct\") pod \"test-model-11aecf-kserve-788ffbd587-fzs6r\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") " pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:45.884162 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:45.884121    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:46.033354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:46.033332    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:32:46.035172 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:32:46.035147    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0040764f_675a_4579_99e0_6afc3028ff19.slice/crio-6df656fe3ef771b130c6b3c2058f5a76c6238c1c878159ec8991e2cea5a86878 WatchSource:0}: Error finding container 6df656fe3ef771b130c6b3c2058f5a76c6238c1c878159ec8991e2cea5a86878: Status 404 returned error can't find the container with id 6df656fe3ef771b130c6b3c2058f5a76c6238c1c878159ec8991e2cea5a86878
Jul 17 22:32:46.821001 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:46.820965    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" event={"ID":"0040764f-675a-4579-99e0-6afc3028ff19","Type":"ContainerStarted","Data":"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"}
Jul 17 22:32:46.821378 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:46.821014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" event={"ID":"0040764f-675a-4579-99e0-6afc3028ff19","Type":"ContainerStarted","Data":"6df656fe3ef771b130c6b3c2058f5a76c6238c1c878159ec8991e2cea5a86878"}
Jul 17 22:32:46.862147 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:46.862097    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" podStartSLOduration=1.862082876 podStartE2EDuration="1.862082876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:32:46.861206522 +0000 UTC m=+2835.340159077" watchObservedRunningTime="2026-07-17 22:32:46.862082876 +0000 UTC m=+2835.341035433"
Jul 17 22:32:55.884337 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:55.884293    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:55.887786 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:55.887728    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:55.907192 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:55.907161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:32:56.882452 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:32:56.882421    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:33:04.974063 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:04.974027    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:04.977761 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:04.977739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:04.980671 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:04.980651    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:33:04.980671 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:04.980660    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 22:33:04.987049 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:04.987020    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:05.084393 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.084352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp\" (UID: \"c4b8472b-b693-48b0-b45e-145f9666894f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:05.185790 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.185750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp\" (UID: \"c4b8472b-b693-48b0-b45e-145f9666894f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:05.186331 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.186312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp\" (UID: \"c4b8472b-b693-48b0-b45e-145f9666894f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:05.289574 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.289536    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:05.433347 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.433321    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:05.435305 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:33:05.435282    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b8472b_b693_48b0_b45e_145f9666894f.slice/crio-b62901e3f18a052c9e6478c3884d4b5d4c1e33a2435c562db735fc29e6978bd3 WatchSource:0}: Error finding container b62901e3f18a052c9e6478c3884d4b5d4c1e33a2435c562db735fc29e6978bd3: Status 404 returned error can't find the container with id b62901e3f18a052c9e6478c3884d4b5d4c1e33a2435c562db735fc29e6978bd3
Jul 17 22:33:05.437262 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.437243    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 22:33:05.918221 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:05.918186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" event={"ID":"c4b8472b-b693-48b0-b45e-145f9666894f","Type":"ContainerStarted","Data":"b62901e3f18a052c9e6478c3884d4b5d4c1e33a2435c562db735fc29e6978bd3"}
Jul 17 22:33:08.936096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:08.936062    2570 generic.go:356] "Generic (PLEG): container finished" podID="c4b8472b-b693-48b0-b45e-145f9666894f" containerID="4ac8321fdda227d27903535eab54b9375c78e9a51d48c1fce4732fabac322d87" exitCode=6
Jul 17 22:33:08.936498 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:08.936118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" event={"ID":"c4b8472b-b693-48b0-b45e-145f9666894f","Type":"ContainerDied","Data":"4ac8321fdda227d27903535eab54b9375c78e9a51d48c1fce4732fabac322d87"}
Jul 17 22:33:08.936498 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:08.936364    2570 scope.go:117] "RemoveContainer" containerID="4ac8321fdda227d27903535eab54b9375c78e9a51d48c1fce4732fabac322d87"
Jul 17 22:33:09.949183 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:09.949132    2570 generic.go:356] "Generic (PLEG): container finished" podID="c4b8472b-b693-48b0-b45e-145f9666894f" containerID="cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0" exitCode=6
Jul 17 22:33:09.949708 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:09.949270    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" event={"ID":"c4b8472b-b693-48b0-b45e-145f9666894f","Type":"ContainerDied","Data":"cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0"}
Jul 17 22:33:09.949708 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:09.949391    2570 scope.go:117] "RemoveContainer" containerID="4ac8321fdda227d27903535eab54b9375c78e9a51d48c1fce4732fabac322d87"
Jul 17 22:33:09.949708 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:09.949592    2570 scope.go:117] "RemoveContainer" containerID="cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0"
Jul 17 22:33:09.949889 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:33:09.949867    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp_odh-ai-gateway-infra(c4b8472b-b693-48b0-b45e-145f9666894f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" podUID="c4b8472b-b693-48b0-b45e-145f9666894f"
Jul 17 22:33:10.957103 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:10.957075    2570 scope.go:117] "RemoveContainer" containerID="cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0"
Jul 17 22:33:10.957693 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:33:10.957322    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp_odh-ai-gateway-infra(c4b8472b-b693-48b0-b45e-145f9666894f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" podUID="c4b8472b-b693-48b0-b45e-145f9666894f"
Jul 17 22:33:22.130898 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.130861    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:33:22.136072 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.136053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.139444 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.139418    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4ccee5\"/\"openshift-service-ca.crt\""
Jul 17 22:33:22.139586 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.139418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4ccee5\"/\"test-model-4ccee5-kserve-self-signed-certs\""
Jul 17 22:33:22.139586 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.139424    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4ccee5\"/\"default-dockercfg-qzcv4\""
Jul 17 22:33:22.139586 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.139463    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4ccee5\"/\"kube-root-ca.crt\""
Jul 17 22:33:22.146748 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.146724    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:33:22.230634 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtldr\" (UniqueName: \"kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.230819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.230819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.230819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.230819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.230819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.230803    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.331936 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.331902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtldr\" (UniqueName: \"kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.331944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.331967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.331992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.332052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.332081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332361 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.332341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332418 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.332389    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.332466 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.332427    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.334459 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.334440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.334743 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.334726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.340268 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.340243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtldr\" (UniqueName: \"kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr\") pod \"test-model-4ccee5-kserve-6686d96599-dprbx\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") " pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.447073 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.446984    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:22.587301 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:22.587262    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:33:22.589949 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:33:22.589925    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf21aae86_12cf_4174_a63a_310ffae4733a.slice/crio-7157e094a807e78b72bc52ae5ecd66b8b6d29d09f55a987405d354f9ff3f644f WatchSource:0}: Error finding container 7157e094a807e78b72bc52ae5ecd66b8b6d29d09f55a987405d354f9ff3f644f: Status 404 returned error can't find the container with id 7157e094a807e78b72bc52ae5ecd66b8b6d29d09f55a987405d354f9ff3f644f
Jul 17 22:33:23.018401 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:23.018363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" event={"ID":"f21aae86-12cf-4174-a63a-310ffae4733a","Type":"ContainerStarted","Data":"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"}
Jul 17 22:33:23.018596 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:23.018415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" event={"ID":"f21aae86-12cf-4174-a63a-310ffae4733a","Type":"ContainerStarted","Data":"7157e094a807e78b72bc52ae5ecd66b8b6d29d09f55a987405d354f9ff3f644f"}
Jul 17 22:33:23.038406 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:23.038345    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" podStartSLOduration=1.038329025 podStartE2EDuration="1.038329025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:33:23.035292781 +0000 UTC m=+2871.514245338" watchObservedRunningTime="2026-07-17 22:33:23.038329025 +0000 UTC m=+2871.517281581"
Jul 17 22:33:24.003420 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:24.003384    2570 scope.go:117] "RemoveContainer" containerID="cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0"
Jul 17 22:33:25.031140 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:25.031058    2570 generic.go:356] "Generic (PLEG): container finished" podID="c4b8472b-b693-48b0-b45e-145f9666894f" containerID="06489d42906a489bd05d6e85d28a93f1a2d899b2e49470a72034abf412d75fec" exitCode=6
Jul 17 22:33:25.031533 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:25.031135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" event={"ID":"c4b8472b-b693-48b0-b45e-145f9666894f","Type":"ContainerDied","Data":"06489d42906a489bd05d6e85d28a93f1a2d899b2e49470a72034abf412d75fec"}
Jul 17 22:33:25.031533 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:25.031206    2570 scope.go:117] "RemoveContainer" containerID="cea3b1b00334be576666e671bdf7f7f70bc56690dc217599fc2aa6677de77db0"
Jul 17 22:33:25.031533 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:25.031474    2570 scope.go:117] "RemoveContainer" containerID="06489d42906a489bd05d6e85d28a93f1a2d899b2e49470a72034abf412d75fec"
Jul 17 22:33:25.031735 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:33:25.031715    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp_odh-ai-gateway-infra(c4b8472b-b693-48b0-b45e-145f9666894f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" podUID="c4b8472b-b693-48b0-b45e-145f9666894f"
Jul 17 22:33:26.063933 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:26.063898    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:26.199979 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:26.199954    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:26.267525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:26.267489    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca\") pod \"c4b8472b-b693-48b0-b45e-145f9666894f\" (UID: \"c4b8472b-b693-48b0-b45e-145f9666894f\") "
Jul 17 22:33:26.267910 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:26.267887    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4b8472b-b693-48b0-b45e-145f9666894f" (UID: "c4b8472b-b693-48b0-b45e-145f9666894f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:33:26.368501 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:26.368418    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b8472b-b693-48b0-b45e-145f9666894f-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:27.044018 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:27.043987    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"
Jul 17 22:33:27.044206 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:27.044026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp" event={"ID":"c4b8472b-b693-48b0-b45e-145f9666894f","Type":"ContainerDied","Data":"b62901e3f18a052c9e6478c3884d4b5d4c1e33a2435c562db735fc29e6978bd3"}
Jul 17 22:33:27.044206 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:27.044100    2570 scope.go:117] "RemoveContainer" containerID="06489d42906a489bd05d6e85d28a93f1a2d899b2e49470a72034abf412d75fec"
Jul 17 22:33:27.064915 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:27.064876    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:27.068656 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:27.068632    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-bs8qp"]
Jul 17 22:33:28.009159 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:28.009124    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" path="/var/lib/kubelet/pods/c4b8472b-b693-48b0-b45e-145f9666894f/volumes"
Jul 17 22:33:32.447338 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:32.447298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:32.447826 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:32.447362    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:32.460454 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:32.460427    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:33.087282 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:33.087255    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:42.519184 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:42.519152    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:33:43.422404 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:43.422370    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:33:57.540062 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.540017    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" podUID="0040764f-675a-4579-99e0-6afc3028ff19" containerName="main" containerID="cri-o://66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089" gracePeriod=45
Jul 17 22:33:57.792333 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.792266    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:33:57.845739 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845694    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.845739 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845742    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrdct\" (UniqueName: \"kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.846001 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845762    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.846001 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845799    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.846001 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845832    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.846001 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.845882    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir\") pod \"0040764f-675a-4579-99e0-6afc3028ff19\" (UID: \"0040764f-675a-4579-99e0-6afc3028ff19\") "
Jul 17 22:33:57.846218 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.846012    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home" (OuterVolumeSpecName: "home") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:57.846218 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.846194    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:57.846218 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.846208    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache" (OuterVolumeSpecName: "model-cache") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:57.846353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.846215    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:57.848182 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.848154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:33:57.848284 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.848179    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct" (OuterVolumeSpecName: "kube-api-access-nrdct") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "kube-api-access-nrdct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:33:57.848284 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.848157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm" (OuterVolumeSpecName: "dshm") pod "0040764f-675a-4579-99e0-6afc3028ff19" (UID: "0040764f-675a-4579-99e0-6afc3028ff19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:57.947158 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.947107    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:57.947158 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.947152    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:57.947158 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.947163    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0040764f-675a-4579-99e0-6afc3028ff19-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:57.947396 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.947178    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrdct\" (UniqueName: \"kubernetes.io/projected/0040764f-675a-4579-99e0-6afc3028ff19-kube-api-access-nrdct\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:57.947396 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:57.947190    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0040764f-675a-4579-99e0-6afc3028ff19-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.205677 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.205558    2570 generic.go:356] "Generic (PLEG): container finished" podID="0040764f-675a-4579-99e0-6afc3028ff19" containerID="66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089" exitCode=0
Jul 17 22:33:58.205677 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.205648    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"
Jul 17 22:33:58.205870 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.205646    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" event={"ID":"0040764f-675a-4579-99e0-6afc3028ff19","Type":"ContainerDied","Data":"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"}
Jul 17 22:33:58.205870 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.205764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r" event={"ID":"0040764f-675a-4579-99e0-6afc3028ff19","Type":"ContainerDied","Data":"6df656fe3ef771b130c6b3c2058f5a76c6238c1c878159ec8991e2cea5a86878"}
Jul 17 22:33:58.205870 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.205781    2570 scope.go:117] "RemoveContainer" containerID="66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"
Jul 17 22:33:58.214686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.214669    2570 scope.go:117] "RemoveContainer" containerID="66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"
Jul 17 22:33:58.214985 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:33:58.214965    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089\": container with ID starting with 66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089 not found: ID does not exist" containerID="66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"
Jul 17 22:33:58.215054 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.214998    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089"} err="failed to get container status \"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089\": rpc error: code = NotFound desc = could not find container \"66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089\": container with ID starting with 66d6bcdccdab2327bf0e94a707a3ba272d8c2d4b10ba2f6fb6e825306ee87089 not found: ID does not exist"
Jul 17 22:33:58.222659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.222635    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:33:58.230999 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.230975    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-11aecf/test-model-11aecf-kserve-788ffbd587-fzs6r"]
Jul 17 22:33:58.351549 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351519    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:33:58.351882 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351869    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0040764f-675a-4579-99e0-6afc3028ff19" containerName="main"
Jul 17 22:33:58.351938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351884    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0040764f-675a-4579-99e0-6afc3028ff19" containerName="main"
Jul 17 22:33:58.351938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.351938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351902    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.351938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351912    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.351938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351917    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.352089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351979    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.352089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351986    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.352089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351991    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:33:58.352089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.351996    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0040764f-675a-4579-99e0-6afc3028ff19" containerName="main"
Jul 17 22:33:58.356252 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.356235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:33:58.359256 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.359233    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:33:58.359562 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.359547    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 22:33:58.363648 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.363506    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:33:58.443647 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.443563    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" podUID="f21aae86-12cf-4174-a63a-310ffae4733a" containerName="main" containerID="cri-o://85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4" gracePeriod=45
Jul 17 22:33:58.450412 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.450385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh\" (UID: \"df18f5d1-5d91-40fc-a4e1-b566f8f9a114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:33:58.551697 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.551647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh\" (UID: \"df18f5d1-5d91-40fc-a4e1-b566f8f9a114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:33:58.552382 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.552358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh\" (UID: \"df18f5d1-5d91-40fc-a4e1-b566f8f9a114\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:33:58.667197 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.667154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:33:58.701497 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.701469    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:58.752825 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.752794    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753009 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.752865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753009 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.752904    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753009 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.752943    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtldr\" (UniqueName: \"kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753009 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.752979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753009 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753008    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm\") pod \"f21aae86-12cf-4174-a63a-310ffae4733a\" (UID: \"f21aae86-12cf-4174-a63a-310ffae4733a\") "
Jul 17 22:33:58.753277 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753170    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:58.753277 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753197    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home" (OuterVolumeSpecName: "home") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:58.753277 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753221    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:58.753277 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753270    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.753426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.753286    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.755444 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.755410    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:33:58.755444 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.755426    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm" (OuterVolumeSpecName: "dshm") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:33:58.755589 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.755490    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr" (OuterVolumeSpecName: "kube-api-access-wtldr") pod "f21aae86-12cf-4174-a63a-310ffae4733a" (UID: "f21aae86-12cf-4174-a63a-310ffae4733a"). InnerVolumeSpecName "kube-api-access-wtldr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:33:58.810592 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.810502    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:33:58.813898 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:33:58.813869    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf18f5d1_5d91_40fc_a4e1_b566f8f9a114.slice/crio-6ca0564a45015b9710ed4ecaadca5c85dfe7aa4c08b20dad0d274234ca3d499f WatchSource:0}: Error finding container 6ca0564a45015b9710ed4ecaadca5c85dfe7aa4c08b20dad0d274234ca3d499f: Status 404 returned error can't find the container with id 6ca0564a45015b9710ed4ecaadca5c85dfe7aa4c08b20dad0d274234ca3d499f
Jul 17 22:33:58.853780 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.853748    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtldr\" (UniqueName: \"kubernetes.io/projected/f21aae86-12cf-4174-a63a-310ffae4733a-kube-api-access-wtldr\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.853780 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.853776    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f21aae86-12cf-4174-a63a-310ffae4733a-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.853924 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.853786    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:58.853924 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:58.853795    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21aae86-12cf-4174-a63a-310ffae4733a-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:33:59.213725 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.213682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerStarted","Data":"3f744cf345cae41f343c93eb68f957bff5b566ee39356209528beeced6431acb"}
Jul 17 22:33:59.213918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.213744    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerStarted","Data":"6ca0564a45015b9710ed4ecaadca5c85dfe7aa4c08b20dad0d274234ca3d499f"}
Jul 17 22:33:59.214930 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.214908    2570 generic.go:356] "Generic (PLEG): container finished" podID="f21aae86-12cf-4174-a63a-310ffae4733a" containerID="85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4" exitCode=0
Jul 17 22:33:59.215019 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.214947    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"
Jul 17 22:33:59.215019 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.214995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" event={"ID":"f21aae86-12cf-4174-a63a-310ffae4733a","Type":"ContainerDied","Data":"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"}
Jul 17 22:33:59.215100 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.215027    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx" event={"ID":"f21aae86-12cf-4174-a63a-310ffae4733a","Type":"ContainerDied","Data":"7157e094a807e78b72bc52ae5ecd66b8b6d29d09f55a987405d354f9ff3f644f"}
Jul 17 22:33:59.215100 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.215047    2570 scope.go:117] "RemoveContainer" containerID="85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"
Jul 17 22:33:59.224220 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.224203    2570 scope.go:117] "RemoveContainer" containerID="85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"
Jul 17 22:33:59.224467 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:33:59.224446    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4\": container with ID starting with 85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4 not found: ID does not exist" containerID="85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"
Jul 17 22:33:59.224887 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.224478    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4"} err="failed to get container status \"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4\": rpc error: code = NotFound desc = could not find container \"85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4\": container with ID starting with 85425f3699508e45f4eac575a94a4fec67830807df27a1c7f4f2ca7ed86fbdf4 not found: ID does not exist"
Jul 17 22:33:59.238121 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.238054    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" podStartSLOduration=1.238040421 podStartE2EDuration="1.238040421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:33:59.236229737 +0000 UTC m=+2907.715182292" watchObservedRunningTime="2026-07-17 22:33:59.238040421 +0000 UTC m=+2907.716992977"
Jul 17 22:33:59.259858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.259831    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:33:59.264223 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:33:59.264203    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4ccee5/test-model-4ccee5-kserve-6686d96599-dprbx"]
Jul 17 22:34:00.010098 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:00.010021    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0040764f-675a-4579-99e0-6afc3028ff19" path="/var/lib/kubelet/pods/0040764f-675a-4579-99e0-6afc3028ff19/volumes"
Jul 17 22:34:00.010448 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:00.010379    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f21aae86-12cf-4174-a63a-310ffae4733a" path="/var/lib/kubelet/pods/f21aae86-12cf-4174-a63a-310ffae4733a/volumes"
Jul 17 22:34:00.224023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:00.223989    2570 generic.go:356] "Generic (PLEG): container finished" podID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerID="3f744cf345cae41f343c93eb68f957bff5b566ee39356209528beeced6431acb" exitCode=6
Jul 17 22:34:00.224224 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:00.224030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerDied","Data":"3f744cf345cae41f343c93eb68f957bff5b566ee39356209528beeced6431acb"}
Jul 17 22:34:00.224313 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:00.224297    2570 scope.go:117] "RemoveContainer" containerID="3f744cf345cae41f343c93eb68f957bff5b566ee39356209528beeced6431acb"
Jul 17 22:34:01.231079 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:01.230989    2570 generic.go:356] "Generic (PLEG): container finished" podID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerID="071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700" exitCode=6
Jul 17 22:34:01.231496 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:01.231077    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerDied","Data":"071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700"}
Jul 17 22:34:01.231496 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:01.231135    2570 scope.go:117] "RemoveContainer" containerID="3f744cf345cae41f343c93eb68f957bff5b566ee39356209528beeced6431acb"
Jul 17 22:34:01.231496 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:01.231338    2570 scope.go:117] "RemoveContainer" containerID="071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700"
Jul 17 22:34:01.231655 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:01.231563    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh_odh-ai-gateway-infra(df18f5d1-5d91-40fc-a4e1-b566f8f9a114)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114"
Jul 17 22:34:02.238416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:02.238387    2570 scope.go:117] "RemoveContainer" containerID="071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700"
Jul 17 22:34:02.238829 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:02.238570    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh_odh-ai-gateway-infra(df18f5d1-5d91-40fc-a4e1-b566f8f9a114)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114"
Jul 17 22:34:05.026367 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026334    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:05.026759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026664    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:34:05.026759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026675    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8472b-b693-48b0-b45e-145f9666894f" containerName="revoke-keys"
Jul 17 22:34:05.026759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026682    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21aae86-12cf-4174-a63a-310ffae4733a" containerName="main"
Jul 17 22:34:05.026759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026688    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21aae86-12cf-4174-a63a-310ffae4733a" containerName="main"
Jul 17 22:34:05.026759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.026753    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f21aae86-12cf-4174-a63a-310ffae4733a" containerName="main"
Jul 17 22:34:05.031107 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.031090    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:05.040278 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.040242    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:05.097473 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.097434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2\" (UID: \"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:05.198064 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.198030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2\" (UID: \"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:05.198657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.198604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2\" (UID: \"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:05.342305 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.342264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:05.475606 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:05.475579    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:05.477971 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:34:05.477945    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be5cc7f_5a70_47d0_af62_9f2d8a56baa2.slice/crio-2626cdc3ce903cb39e3ec8bfee7bd46f247782763fa4d79b561a21dc56af09d5 WatchSource:0}: Error finding container 2626cdc3ce903cb39e3ec8bfee7bd46f247782763fa4d79b561a21dc56af09d5: Status 404 returned error can't find the container with id 2626cdc3ce903cb39e3ec8bfee7bd46f247782763fa4d79b561a21dc56af09d5
Jul 17 22:34:06.260370 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:06.260333    2570 generic.go:356] "Generic (PLEG): container finished" podID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerID="be43725256b9c2b39cc96a23287de228446b995b57d8d5e3b97bd3d818e2dd02" exitCode=6
Jul 17 22:34:06.260774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:06.260420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerDied","Data":"be43725256b9c2b39cc96a23287de228446b995b57d8d5e3b97bd3d818e2dd02"}
Jul 17 22:34:06.260774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:06.260476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerStarted","Data":"2626cdc3ce903cb39e3ec8bfee7bd46f247782763fa4d79b561a21dc56af09d5"}
Jul 17 22:34:06.260774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:06.260650    2570 scope.go:117] "RemoveContainer" containerID="be43725256b9c2b39cc96a23287de228446b995b57d8d5e3b97bd3d818e2dd02"
Jul 17 22:34:07.267106 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:07.267014    2570 generic.go:356] "Generic (PLEG): container finished" podID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerID="dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213" exitCode=6
Jul 17 22:34:07.267510 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:07.267102    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerDied","Data":"dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213"}
Jul 17 22:34:07.267510 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:07.267155    2570 scope.go:117] "RemoveContainer" containerID="be43725256b9c2b39cc96a23287de228446b995b57d8d5e3b97bd3d818e2dd02"
Jul 17 22:34:07.267510 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:07.267357    2570 scope.go:117] "RemoveContainer" containerID="dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213"
Jul 17 22:34:07.267664 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:07.267583    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2_odh-ai-gateway-infra(1be5cc7f-5a70-47d0-af62-9f2d8a56baa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2"
Jul 17 22:34:08.273752 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:08.273719    2570 scope.go:117] "RemoveContainer" containerID="dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213"
Jul 17 22:34:08.274234 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:08.273976    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2_odh-ai-gateway-infra(1be5cc7f-5a70-47d0-af62-9f2d8a56baa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2"
Jul 17 22:34:09.707385 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.707353    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"]
Jul 17 22:34:09.711872 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.711853    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:09.719119 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.719090    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"]
Jul 17 22:34:09.733097 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.733064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n\" (UID: \"0a724afb-283f-44e6-8326-b374577188bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:09.834476 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.834443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n\" (UID: \"0a724afb-283f-44e6-8326-b374577188bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:09.835087 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:09.835063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n\" (UID: \"0a724afb-283f-44e6-8326-b374577188bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:10.023102 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:10.023019    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:10.180214 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:10.180153    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"]
Jul 17 22:34:10.182486 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:34:10.182451    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a724afb_283f_44e6_8326_b374577188bf.slice/crio-6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536 WatchSource:0}: Error finding container 6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536: Status 404 returned error can't find the container with id 6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536
Jul 17 22:34:10.284887 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:10.284810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n" event={"ID":"0a724afb-283f-44e6-8326-b374577188bf","Type":"ContainerStarted","Data":"6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536"}
Jul 17 22:34:11.291121 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:11.291087    2570 generic.go:356] "Generic (PLEG): container finished" podID="0a724afb-283f-44e6-8326-b374577188bf" containerID="5b784d07a8627aad3d13da4363f1118c3ea4856c3ba8ea8610b423d8da83f156" exitCode=0
Jul 17 22:34:11.291511 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:11.291141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n" event={"ID":"0a724afb-283f-44e6-8326-b374577188bf","Type":"ContainerDied","Data":"5b784d07a8627aad3d13da4363f1118c3ea4856c3ba8ea8610b423d8da83f156"}
Jul 17 22:34:12.425539 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:12.425514    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:12.456733 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:12.456697    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca\") pod \"0a724afb-283f-44e6-8326-b374577188bf\" (UID: \"0a724afb-283f-44e6-8326-b374577188bf\") "
Jul 17 22:34:12.457041 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:12.457015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a724afb-283f-44e6-8326-b374577188bf" (UID: "0a724afb-283f-44e6-8326-b374577188bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:34:12.558267 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:12.558182    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a724afb-283f-44e6-8326-b374577188bf-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:34:13.302184 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:13.302153    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n" event={"ID":"0a724afb-283f-44e6-8326-b374577188bf","Type":"ContainerDied","Data":"6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536"}
Jul 17 22:34:13.302184 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:13.302175    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n"
Jul 17 22:34:13.302402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:13.302203    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6381a9fa226bf418e26198d8457549e7d6ffd0c441e9107aa74b211f58316536"
Jul 17 22:34:15.003636 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:15.003578    2570 scope.go:117] "RemoveContainer" containerID="071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700"
Jul 17 22:34:15.314529 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:15.314492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerStarted","Data":"a952503693b0efbf9ebf46b012abf8c859e0a66430a6f23b628d80a1c4cb77b5"}
Jul 17 22:34:16.320974 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:16.320942    2570 generic.go:356] "Generic (PLEG): container finished" podID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerID="a952503693b0efbf9ebf46b012abf8c859e0a66430a6f23b628d80a1c4cb77b5" exitCode=6
Jul 17 22:34:16.321426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:16.320992    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerDied","Data":"a952503693b0efbf9ebf46b012abf8c859e0a66430a6f23b628d80a1c4cb77b5"}
Jul 17 22:34:16.321426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:16.321042    2570 scope.go:117] "RemoveContainer" containerID="071d950a21cc0c911280baebb626dce1e43c547bbd4f946114f61457de663700"
Jul 17 22:34:16.321426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:16.321304    2570 scope.go:117] "RemoveContainer" containerID="a952503693b0efbf9ebf46b012abf8c859e0a66430a6f23b628d80a1c4cb77b5"
Jul 17 22:34:16.321541 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:16.321505    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh_odh-ai-gateway-infra(df18f5d1-5d91-40fc-a4e1-b566f8f9a114)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114"
Jul 17 22:34:16.353544 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:16.353515    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:34:17.461994 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:17.461967    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:34:17.503209 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:17.503179    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca\") pod \"df18f5d1-5d91-40fc-a4e1-b566f8f9a114\" (UID: \"df18f5d1-5d91-40fc-a4e1-b566f8f9a114\") "
Jul 17 22:34:17.503542 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:17.503520    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "df18f5d1-5d91-40fc-a4e1-b566f8f9a114" (UID: "df18f5d1-5d91-40fc-a4e1-b566f8f9a114"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:34:17.604354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:17.604260    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df18f5d1-5d91-40fc-a4e1-b566f8f9a114-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:34:18.335235 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:18.335204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh" event={"ID":"df18f5d1-5d91-40fc-a4e1-b566f8f9a114","Type":"ContainerDied","Data":"6ca0564a45015b9710ed4ecaadca5c85dfe7aa4c08b20dad0d274234ca3d499f"}
Jul 17 22:34:18.335235 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:18.335223    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"
Jul 17 22:34:18.335481 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:18.335273    2570 scope.go:117] "RemoveContainer" containerID="a952503693b0efbf9ebf46b012abf8c859e0a66430a6f23b628d80a1c4cb77b5"
Jul 17 22:34:18.352728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:18.352697    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:34:18.359023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:18.358995    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tq6xh"]
Jul 17 22:34:20.007979 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:20.007946    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" path="/var/lib/kubelet/pods/df18f5d1-5d91-40fc-a4e1-b566f8f9a114/volumes"
Jul 17 22:34:24.003271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:24.003238    2570 scope.go:117] "RemoveContainer" containerID="dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213"
Jul 17 22:34:24.373861 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:24.373826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerStarted","Data":"22ceb5e90120321584be904c2809825d421c4d2acdd97acb3a941a9f61eba18f"}
Jul 17 22:34:24.391856 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:24.391811    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" podStartSLOduration=19.391793774 podStartE2EDuration="19.391793774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:34:24.390430127 +0000 UTC m=+2932.869382683" watchObservedRunningTime="2026-07-17 22:34:24.391793774 +0000 UTC m=+2932.870746331"
Jul 17 22:34:25.380528 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:25.380497    2570 generic.go:356] "Generic (PLEG): container finished" podID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerID="22ceb5e90120321584be904c2809825d421c4d2acdd97acb3a941a9f61eba18f" exitCode=6
Jul 17 22:34:25.380980 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:25.380572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerDied","Data":"22ceb5e90120321584be904c2809825d421c4d2acdd97acb3a941a9f61eba18f"}
Jul 17 22:34:25.380980 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:25.380653    2570 scope.go:117] "RemoveContainer" containerID="dabd70e3efeeefcc1077843b1cc61398cbd6aea44a334c6d43d6e9ad7f3e8213"
Jul 17 22:34:25.380980 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:25.380866    2570 scope.go:117] "RemoveContainer" containerID="22ceb5e90120321584be904c2809825d421c4d2acdd97acb3a941a9f61eba18f"
Jul 17 22:34:25.381150 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:25.381090    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2_odh-ai-gateway-infra(1be5cc7f-5a70-47d0-af62-9f2d8a56baa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2"
Jul 17 22:34:25.409354 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:25.409320    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:26.521660 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:26.521593    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:26.582438 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:26.582410    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca\") pod \"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2\" (UID: \"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2\") "
Jul 17 22:34:26.582780 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:26.582759    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" (UID: "1be5cc7f-5a70-47d0-af62-9f2d8a56baa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:34:26.683458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:26.683376    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:34:27.392776 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:27.392746    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"
Jul 17 22:34:27.392932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:27.392746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2" event={"ID":"1be5cc7f-5a70-47d0-af62-9f2d8a56baa2","Type":"ContainerDied","Data":"2626cdc3ce903cb39e3ec8bfee7bd46f247782763fa4d79b561a21dc56af09d5"}
Jul 17 22:34:27.392932 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:27.392887    2570 scope.go:117] "RemoveContainer" containerID="22ceb5e90120321584be904c2809825d421c4d2acdd97acb3a941a9f61eba18f"
Jul 17 22:34:27.414114 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:27.414085    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:27.421439 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:27.421411    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-hnxx2"]
Jul 17 22:34:28.009395 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:28.009361    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" path="/var/lib/kubelet/pods/1be5cc7f-5a70-47d0-af62-9f2d8a56baa2/volumes"
Jul 17 22:34:36.613479 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613437    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613794    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613806    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613816    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613822    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613831    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613837    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613852    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613858    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613865    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613870    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613879    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613884    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613890    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a724afb-283f-44e6-8326-b374577188bf" containerName="revoke-keys"
Jul 17 22:34:36.613918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613895    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a724afb-283f-44e6-8326-b374577188bf" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613952    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613961    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613967    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613973    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a724afb-283f-44e6-8326-b374577188bf" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613978    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613983    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be5cc7f-5a70-47d0-af62-9f2d8a56baa2" containerName="revoke-keys"
Jul 17 22:34:36.614341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.613989    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df18f5d1-5d91-40fc-a4e1-b566f8f9a114" containerName="revoke-keys"
Jul 17 22:34:36.618421 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.618402    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:36.620899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.620861    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 22:34:36.621016 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.620951    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:34:36.626943 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.626917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:36.663053 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.663015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd\" (UID: \"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:36.764455 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.764419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd\" (UID: \"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:36.765060 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.765041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd\" (UID: \"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:36.929657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:36.929542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:37.075765 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:37.075732    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:37.079036 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:34:37.079004    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34efe81b_0cdf_4453_b9e2_2a4a01c5ba99.slice/crio-9ddcbd1789755e37c80c25f7ec61cca5fe26b57505fe6e7883d76c3625577664 WatchSource:0}: Error finding container 9ddcbd1789755e37c80c25f7ec61cca5fe26b57505fe6e7883d76c3625577664: Status 404 returned error can't find the container with id 9ddcbd1789755e37c80c25f7ec61cca5fe26b57505fe6e7883d76c3625577664
Jul 17 22:34:37.452055 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:37.452018    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerStarted","Data":"d456c9182a58809d2e67c5afe809729c21f8c06888458e12c9b18942d9d75fad"}
Jul 17 22:34:37.452231 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:37.452080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerStarted","Data":"9ddcbd1789755e37c80c25f7ec61cca5fe26b57505fe6e7883d76c3625577664"}
Jul 17 22:34:37.470423 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:37.470373    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" podStartSLOduration=1.470357375 podStartE2EDuration="1.470357375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:34:37.469360508 +0000 UTC m=+2945.948313066" watchObservedRunningTime="2026-07-17 22:34:37.470357375 +0000 UTC m=+2945.949309930"
Jul 17 22:34:38.458758 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:38.458722    2570 generic.go:356] "Generic (PLEG): container finished" podID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerID="d456c9182a58809d2e67c5afe809729c21f8c06888458e12c9b18942d9d75fad" exitCode=6
Jul 17 22:34:38.459204 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:38.458804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerDied","Data":"d456c9182a58809d2e67c5afe809729c21f8c06888458e12c9b18942d9d75fad"}
Jul 17 22:34:38.459204 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:38.458974    2570 scope.go:117] "RemoveContainer" containerID="d456c9182a58809d2e67c5afe809729c21f8c06888458e12c9b18942d9d75fad"
Jul 17 22:34:39.465682 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:39.465561    2570 generic.go:356] "Generic (PLEG): container finished" podID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerID="7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae" exitCode=6
Jul 17 22:34:39.465682 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:39.465647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerDied","Data":"7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae"}
Jul 17 22:34:39.466204 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:39.465707    2570 scope.go:117] "RemoveContainer" containerID="d456c9182a58809d2e67c5afe809729c21f8c06888458e12c9b18942d9d75fad"
Jul 17 22:34:39.466204 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:39.465918    2570 scope.go:117] "RemoveContainer" containerID="7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae"
Jul 17 22:34:39.466204 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:39.466155    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd_odh-ai-gateway-infra(34efe81b-0cdf-4453-b9e2-2a4a01c5ba99)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99"
Jul 17 22:34:40.471934 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:40.471906    2570 scope.go:117] "RemoveContainer" containerID="7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae"
Jul 17 22:34:40.472323 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:40.472100    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd_odh-ai-gateway-infra(34efe81b-0cdf-4453-b9e2-2a4a01c5ba99)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99"
Jul 17 22:34:48.050271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.050236    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:34:48.053507 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.053485    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.056742 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.056721    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vxq68\""
Jul 17 22:34:48.056925 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.056721    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-bf8fd3-serving-cert\""
Jul 17 22:34:48.057053 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.056736    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 22:34:48.071745 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.071713    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:34:48.163452 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.163416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.163666 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.163456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.163666 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.163522    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhghg\" (UniqueName: \"kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.264758 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.264721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.264758 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.264758    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.264969 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.264793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhghg\" (UniqueName: \"kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.264969 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:48.264881    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-serving-cert: secret "maas-api-e2e-api-b-bf8fd3-serving-cert" not found
Jul 17 22:34:48.265038 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:48.264977    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls podName:465c21d7-213d-43a3-a7cf-43e3b5c782b6 nodeName:}" failed. No retries permitted until 2026-07-17 22:34:48.764955663 +0000 UTC m=+2957.243908203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls") pod "maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" (UID: "465c21d7-213d-43a3-a7cf-43e3b5c782b6") : secret "maas-api-e2e-api-b-bf8fd3-serving-cert" not found
Jul 17 22:34:48.265348 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.265330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.285995 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.285962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhghg\" (UniqueName: \"kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.769671 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.769602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.772223 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.772203    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") pod \"maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:48.964964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:48.964910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:49.264854 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:49.264818    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:34:49.282511 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:34:49.282484    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465c21d7_213d_43a3_a7cf_43e3b5c782b6.slice/crio-217d8e016338c7cd5cb393a57fe55099107a5cacb9450b44cbfa1635f6c8122d WatchSource:0}: Error finding container 217d8e016338c7cd5cb393a57fe55099107a5cacb9450b44cbfa1635f6c8122d: Status 404 returned error can't find the container with id 217d8e016338c7cd5cb393a57fe55099107a5cacb9450b44cbfa1635f6c8122d
Jul 17 22:34:49.517128 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:49.517045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" event={"ID":"465c21d7-213d-43a3-a7cf-43e3b5c782b6","Type":"ContainerStarted","Data":"217d8e016338c7cd5cb393a57fe55099107a5cacb9450b44cbfa1635f6c8122d"}
Jul 17 22:34:51.531234 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:51.531195    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" event={"ID":"465c21d7-213d-43a3-a7cf-43e3b5c782b6","Type":"ContainerStarted","Data":"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"}
Jul 17 22:34:51.531680 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:51.531291    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:51.550173 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:51.550118    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" podStartSLOduration=1.417682579 podStartE2EDuration="3.550099001s" totalImagesPullingTime="2.132416422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:34:51.547694277 +0000 UTC m=+2960.026646815" watchObservedRunningTime="2026-07-17 22:34:51.550099001 +0000 UTC m=+2960.029051557"
Jul 17 22:34:53.003231 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:53.003201    2570 scope.go:117] "RemoveContainer" containerID="7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae"
Jul 17 22:34:53.543598 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:53.543565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerStarted","Data":"aeffe9f9159ada1502e9912c28e6e367d1619e2ce86a89b7666d617212ff84f4"}
Jul 17 22:34:54.550253 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:54.550221    2570 generic.go:356] "Generic (PLEG): container finished" podID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerID="aeffe9f9159ada1502e9912c28e6e367d1619e2ce86a89b7666d617212ff84f4" exitCode=6
Jul 17 22:34:54.550675 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:54.550292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerDied","Data":"aeffe9f9159ada1502e9912c28e6e367d1619e2ce86a89b7666d617212ff84f4"}
Jul 17 22:34:54.550675 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:54.550352    2570 scope.go:117] "RemoveContainer" containerID="7b1ead90242030846e18db0cb38b4c5a12ea002d08e1a34afffe98853f3f71ae"
Jul 17 22:34:54.550762 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:54.550674    2570 scope.go:117] "RemoveContainer" containerID="aeffe9f9159ada1502e9912c28e6e367d1619e2ce86a89b7666d617212ff84f4"
Jul 17 22:34:54.550900 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:34:54.550877    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd_odh-ai-gateway-infra(34efe81b-0cdf-4453-b9e2-2a4a01c5ba99)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99"
Jul 17 22:34:54.580516 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:54.580489    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:55.690425 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:55.690397    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:55.833780 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:55.833686    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca\") pod \"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99\" (UID: \"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99\") "
Jul 17 22:34:55.834066 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:55.834039    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" (UID: "34efe81b-0cdf-4453-b9e2-2a4a01c5ba99"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:34:55.934906 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:55.934869    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:34:56.563732 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:56.563696    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"
Jul 17 22:34:56.563907 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:56.563688    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd" event={"ID":"34efe81b-0cdf-4453-b9e2-2a4a01c5ba99","Type":"ContainerDied","Data":"9ddcbd1789755e37c80c25f7ec61cca5fe26b57505fe6e7883d76c3625577664"}
Jul 17 22:34:56.563907 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:56.563845    2570 scope.go:117] "RemoveContainer" containerID="aeffe9f9159ada1502e9912c28e6e367d1619e2ce86a89b7666d617212ff84f4"
Jul 17 22:34:56.583483 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:56.583452    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:56.591181 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:56.591150    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-sj2fd"]
Jul 17 22:34:57.542798 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:57.542769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:34:58.008602 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.008520    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" path="/var/lib/kubelet/pods/34efe81b-0cdf-4453-b9e2-2a4a01c5ba99/volumes"
Jul 17 22:34:58.404032 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.403993    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:34:58.404356 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404341    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404359    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404368    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404373    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404389    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404402 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404394    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404548 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404465    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.404548 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.404474    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:34:58.408687 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.408670    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:34:58.411010 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.410990    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:34:58.414755 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.414732    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:34:58.559098 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.559057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k\" (UID: \"d549d0e4-ca74-4161-b2c2-9bea306a021a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:34:58.660070 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.659969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k\" (UID: \"d549d0e4-ca74-4161-b2c2-9bea306a021a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:34:58.660688 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.660663    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k\" (UID: \"d549d0e4-ca74-4161-b2c2-9bea306a021a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:34:58.720889 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.720852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:34:58.862228 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:58.862197    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:34:58.863446 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:34:58.863413    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd549d0e4_ca74_4161_b2c2_9bea306a021a.slice/crio-26ecafb0fb2d571163a43f5527d409fccb076472df3204b8748c8408a921c5d4 WatchSource:0}: Error finding container 26ecafb0fb2d571163a43f5527d409fccb076472df3204b8748c8408a921c5d4: Status 404 returned error can't find the container with id 26ecafb0fb2d571163a43f5527d409fccb076472df3204b8748c8408a921c5d4
Jul 17 22:34:59.583445 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:59.583410    2570 generic.go:356] "Generic (PLEG): container finished" podID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerID="3a822172e6266a71ff0904e069615b890c2a4fd2e47d30557d119e13cd5fc237" exitCode=6
Jul 17 22:34:59.583890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:59.583503    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerDied","Data":"3a822172e6266a71ff0904e069615b890c2a4fd2e47d30557d119e13cd5fc237"}
Jul 17 22:34:59.583890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:59.583565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerStarted","Data":"26ecafb0fb2d571163a43f5527d409fccb076472df3204b8748c8408a921c5d4"}
Jul 17 22:34:59.583890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:34:59.583706    2570 scope.go:117] "RemoveContainer" containerID="3a822172e6266a71ff0904e069615b890c2a4fd2e47d30557d119e13cd5fc237"
Jul 17 22:35:00.403071 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.402992    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"]
Jul 17 22:35:00.403382 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.403370    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="34efe81b-0cdf-4453-b9e2-2a4a01c5ba99" containerName="revoke-keys"
Jul 17 22:35:00.406189 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.406174    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:00.414337 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.414119    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"]
Jul 17 22:35:00.578205 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.578166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5abe32-whf4j\" (UID: \"11637886-7f9f-41c1-b394-61ebbe71c2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:00.590461 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.590426    2570 generic.go:356] "Generic (PLEG): container finished" podID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerID="6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26" exitCode=6
Jul 17 22:35:00.590923 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.590494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerDied","Data":"6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26"}
Jul 17 22:35:00.590923 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.590559    2570 scope.go:117] "RemoveContainer" containerID="3a822172e6266a71ff0904e069615b890c2a4fd2e47d30557d119e13cd5fc237"
Jul 17 22:35:00.590923 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.590783    2570 scope.go:117] "RemoveContainer" containerID="6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26"
Jul 17 22:35:00.591085 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:00.590992    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k_odh-ai-gateway-infra(d549d0e4-ca74-4161-b2c2-9bea306a021a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a"
Jul 17 22:35:00.678943 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.678847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5abe32-whf4j\" (UID: \"11637886-7f9f-41c1-b394-61ebbe71c2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:00.679459 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.679437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5abe32-whf4j\" (UID: \"11637886-7f9f-41c1-b394-61ebbe71c2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:00.717598 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.717558    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:00.864351 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:00.864326    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"]
Jul 17 22:35:00.866241 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:00.866213    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11637886_7f9f_41c1_b394_61ebbe71c2b4.slice/crio-6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07 WatchSource:0}: Error finding container 6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07: Status 404 returned error can't find the container with id 6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07
Jul 17 22:35:01.597234 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:01.597203    2570 generic.go:356] "Generic (PLEG): container finished" podID="11637886-7f9f-41c1-b394-61ebbe71c2b4" containerID="eca38afae40c704d35bfc3f03cce4b0c7dc4bc30dec8a8bb40a20506bdea37b4" exitCode=0
Jul 17 22:35:01.597724 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:01.597287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j" event={"ID":"11637886-7f9f-41c1-b394-61ebbe71c2b4","Type":"ContainerDied","Data":"eca38afae40c704d35bfc3f03cce4b0c7dc4bc30dec8a8bb40a20506bdea37b4"}
Jul 17 22:35:01.597724 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:01.597342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j" event={"ID":"11637886-7f9f-41c1-b394-61ebbe71c2b4","Type":"ContainerStarted","Data":"6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07"}
Jul 17 22:35:01.599166 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:01.599147    2570 scope.go:117] "RemoveContainer" containerID="6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26"
Jul 17 22:35:01.599371 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:01.599352    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k_odh-ai-gateway-infra(d549d0e4-ca74-4161-b2c2-9bea306a021a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a"
Jul 17 22:35:02.739382 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:02.739352    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:02.896727 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:02.896602    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca\") pod \"11637886-7f9f-41c1-b394-61ebbe71c2b4\" (UID: \"11637886-7f9f-41c1-b394-61ebbe71c2b4\") "
Jul 17 22:35:02.896967 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:02.896946    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11637886-7f9f-41c1-b394-61ebbe71c2b4" (UID: "11637886-7f9f-41c1-b394-61ebbe71c2b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:02.997984 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:02.997946    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11637886-7f9f-41c1-b394-61ebbe71c2b4-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:03.609933 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:03.609899    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j" event={"ID":"11637886-7f9f-41c1-b394-61ebbe71c2b4","Type":"ContainerDied","Data":"6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07"}
Jul 17 22:35:03.609933 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:03.609923    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5abe32-whf4j"
Jul 17 22:35:03.610225 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:03.609948    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6db1473da78801a416a272ec59c5fc61ecf07c24334df1de73fc64f90f11fc07"
Jul 17 22:35:05.121005 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.120967    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:05.121387 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.121330    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11637886-7f9f-41c1-b394-61ebbe71c2b4" containerName="revoke-keys"
Jul 17 22:35:05.121387 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.121343    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="11637886-7f9f-41c1-b394-61ebbe71c2b4" containerName="revoke-keys"
Jul 17 22:35:05.121458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.121405    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="11637886-7f9f-41c1-b394-61ebbe71c2b4" containerName="revoke-keys"
Jul 17 22:35:05.124341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.124324    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:05.149833 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.149782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:05.219200 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.219168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v\" (UID: \"7701ca21-4fc5-47c5-ac6a-da890a5c31d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:05.320700 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.320662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v\" (UID: \"7701ca21-4fc5-47c5-ac6a-da890a5c31d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:05.321310 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.321288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v\" (UID: \"7701ca21-4fc5-47c5-ac6a-da890a5c31d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:05.433833 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.433733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:05.573693 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.573667    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:05.575301 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:05.575275    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7701ca21_4fc5_47c5_ac6a_da890a5c31d5.slice/crio-0fb5af1f9f971f803fb7f4d5266384b3e5c9daad81b7a9375e8e50e966479d97 WatchSource:0}: Error finding container 0fb5af1f9f971f803fb7f4d5266384b3e5c9daad81b7a9375e8e50e966479d97: Status 404 returned error can't find the container with id 0fb5af1f9f971f803fb7f4d5266384b3e5c9daad81b7a9375e8e50e966479d97
Jul 17 22:35:05.620883 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:05.620847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" event={"ID":"7701ca21-4fc5-47c5-ac6a-da890a5c31d5","Type":"ContainerStarted","Data":"0fb5af1f9f971f803fb7f4d5266384b3e5c9daad81b7a9375e8e50e966479d97"}
Jul 17 22:35:06.627757 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:06.627708    2570 generic.go:356] "Generic (PLEG): container finished" podID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerID="99b4accab281e4e806744cfb3971c040c1399033aba7b0634e1ed4a183295daf" exitCode=6
Jul 17 22:35:06.628138 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:06.627795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" event={"ID":"7701ca21-4fc5-47c5-ac6a-da890a5c31d5","Type":"ContainerDied","Data":"99b4accab281e4e806744cfb3971c040c1399033aba7b0634e1ed4a183295daf"}
Jul 17 22:35:06.628138 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:06.628010    2570 scope.go:117] "RemoveContainer" containerID="99b4accab281e4e806744cfb3971c040c1399033aba7b0634e1ed4a183295daf"
Jul 17 22:35:07.635735 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:07.635609    2570 generic.go:356] "Generic (PLEG): container finished" podID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerID="525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53" exitCode=6
Jul 17 22:35:07.636185 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:07.635736    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" event={"ID":"7701ca21-4fc5-47c5-ac6a-da890a5c31d5","Type":"ContainerDied","Data":"525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53"}
Jul 17 22:35:07.636185 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:07.635798    2570 scope.go:117] "RemoveContainer" containerID="99b4accab281e4e806744cfb3971c040c1399033aba7b0634e1ed4a183295daf"
Jul 17 22:35:07.636185 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:07.635974    2570 scope.go:117] "RemoveContainer" containerID="525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53"
Jul 17 22:35:07.636337 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:07.636195    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v_odh-ai-gateway-infra(7701ca21-4fc5-47c5-ac6a-da890a5c31d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5"
Jul 17 22:35:08.643148 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:08.643111    2570 scope.go:117] "RemoveContainer" containerID="525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53"
Jul 17 22:35:08.643499 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:08.643293    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v_odh-ai-gateway-infra(7701ca21-4fc5-47c5-ac6a-da890a5c31d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5"
Jul 17 22:35:13.003311 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.003275    2570 scope.go:117] "RemoveContainer" containerID="6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26"
Jul 17 22:35:13.007950 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.007926    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:13.011897 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.011878    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:13.020140 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.020116    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:13.185163 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.185126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd\" (UID: \"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:13.285748 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.285715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd\" (UID: \"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:13.286363 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.286343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd\" (UID: \"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:13.352678 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.352653    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:13.487234 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.487202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:13.488639 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:13.488579    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bce7ff2_0de9_48b1_a8d6_7d47e55aeeab.slice/crio-70760ee675b5f530619c6429f00d84f13bd815d8d8c82d559c8b7d0fc17f2b30 WatchSource:0}: Error finding container 70760ee675b5f530619c6429f00d84f13bd815d8d8c82d559c8b7d0fc17f2b30: Status 404 returned error can't find the container with id 70760ee675b5f530619c6429f00d84f13bd815d8d8c82d559c8b7d0fc17f2b30
Jul 17 22:35:13.670132 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.670096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" event={"ID":"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab","Type":"ContainerStarted","Data":"70760ee675b5f530619c6429f00d84f13bd815d8d8c82d559c8b7d0fc17f2b30"}
Jul 17 22:35:13.671906 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.671883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerStarted","Data":"d6bfaf34d6acfbe1143dbe158e35932dc093df4c880d0c07aa36de0c79637e65"}
Jul 17 22:35:13.693696 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:13.693643    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" podStartSLOduration=15.693605225 podStartE2EDuration="15.693605225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:35:13.691142489 +0000 UTC m=+2982.170095045" watchObservedRunningTime="2026-07-17 22:35:13.693605225 +0000 UTC m=+2982.172557822"
Jul 17 22:35:14.678460 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.678424    2570 generic.go:356] "Generic (PLEG): container finished" podID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerID="b2d31f3e3d42ef24a96f607ef91eec93c82023cc53780e513080793a82de7586" exitCode=6
Jul 17 22:35:14.678888 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.678506    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" event={"ID":"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab","Type":"ContainerDied","Data":"b2d31f3e3d42ef24a96f607ef91eec93c82023cc53780e513080793a82de7586"}
Jul 17 22:35:14.678888 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.678738    2570 scope.go:117] "RemoveContainer" containerID="b2d31f3e3d42ef24a96f607ef91eec93c82023cc53780e513080793a82de7586"
Jul 17 22:35:14.680673 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.680654    2570 generic.go:356] "Generic (PLEG): container finished" podID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerID="d6bfaf34d6acfbe1143dbe158e35932dc093df4c880d0c07aa36de0c79637e65" exitCode=6
Jul 17 22:35:14.680771 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.680725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerDied","Data":"d6bfaf34d6acfbe1143dbe158e35932dc093df4c880d0c07aa36de0c79637e65"}
Jul 17 22:35:14.680771 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.680762    2570 scope.go:117] "RemoveContainer" containerID="6d0e0503cb7aeb6d0dd66cd79ac3f4780a50e155d1bf12b5ece1252f3130bc26"
Jul 17 22:35:14.681025 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.680990    2570 scope.go:117] "RemoveContainer" containerID="d6bfaf34d6acfbe1143dbe158e35932dc093df4c880d0c07aa36de0c79637e65"
Jul 17 22:35:14.681166 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:14.681149    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k_odh-ai-gateway-infra(d549d0e4-ca74-4161-b2c2-9bea306a021a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a"
Jul 17 22:35:14.704264 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:14.704233    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:35:15.688277 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.688239    2570 generic.go:356] "Generic (PLEG): container finished" podID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerID="84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f" exitCode=6
Jul 17 22:35:15.688764 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.688329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" event={"ID":"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab","Type":"ContainerDied","Data":"84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f"}
Jul 17 22:35:15.688764 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.688415    2570 scope.go:117] "RemoveContainer" containerID="b2d31f3e3d42ef24a96f607ef91eec93c82023cc53780e513080793a82de7586"
Jul 17 22:35:15.688764 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.688592    2570 scope.go:117] "RemoveContainer" containerID="84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f"
Jul 17 22:35:15.688900 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:15.688843    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd_odh-ai-gateway-infra(0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab"
Jul 17 22:35:15.824272 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.824249    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:35:15.903133 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.903093    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca\") pod \"d549d0e4-ca74-4161-b2c2-9bea306a021a\" (UID: \"d549d0e4-ca74-4161-b2c2-9bea306a021a\") "
Jul 17 22:35:15.903441 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:15.903419    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d549d0e4-ca74-4161-b2c2-9bea306a021a" (UID: "d549d0e4-ca74-4161-b2c2-9bea306a021a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:16.004173 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.004090    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d549d0e4-ca74-4161-b2c2-9bea306a021a-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:16.696918 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.696886    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"
Jul 17 22:35:16.697371 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.696931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k" event={"ID":"d549d0e4-ca74-4161-b2c2-9bea306a021a","Type":"ContainerDied","Data":"26ecafb0fb2d571163a43f5527d409fccb076472df3204b8748c8408a921c5d4"}
Jul 17 22:35:16.697371 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.697001    2570 scope.go:117] "RemoveContainer" containerID="d6bfaf34d6acfbe1143dbe158e35932dc093df4c880d0c07aa36de0c79637e65"
Jul 17 22:35:16.699067 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.699045    2570 scope.go:117] "RemoveContainer" containerID="84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f"
Jul 17 22:35:16.699316 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:16.699289    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd_odh-ai-gateway-infra(0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab"
Jul 17 22:35:16.714968 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.714934    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:35:16.719720 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:16.719696    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-x7r6k"]
Jul 17 22:35:18.009002 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:18.008967    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" path="/var/lib/kubelet/pods/d549d0e4-ca74-4161-b2c2-9bea306a021a/volumes"
Jul 17 22:35:20.002790 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:20.002763    2570 scope.go:117] "RemoveContainer" containerID="525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53"
Jul 17 22:35:20.722906 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:20.722873    2570 generic.go:356] "Generic (PLEG): container finished" podID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerID="c4decfd89d437e6dcca73ef8fdac495551f09d280b0ab27da56b425f1f26f008" exitCode=6
Jul 17 22:35:20.723058 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:20.722944    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" event={"ID":"7701ca21-4fc5-47c5-ac6a-da890a5c31d5","Type":"ContainerDied","Data":"c4decfd89d437e6dcca73ef8fdac495551f09d280b0ab27da56b425f1f26f008"}
Jul 17 22:35:20.723058 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:20.723015    2570 scope.go:117] "RemoveContainer" containerID="525d6d5c3ac468e2a2b434b55059b1c1816f46a99dcc5971a7b1150eebac7d53"
Jul 17 22:35:20.723312 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:20.723296    2570 scope.go:117] "RemoveContainer" containerID="c4decfd89d437e6dcca73ef8fdac495551f09d280b0ab27da56b425f1f26f008"
Jul 17 22:35:20.723534 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:20.723512    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v_odh-ai-gateway-infra(7701ca21-4fc5-47c5-ac6a-da890a5c31d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5"
Jul 17 22:35:21.754837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:21.754798    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:21.893420 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:21.893394    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:22.047023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.046983    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca\") pod \"7701ca21-4fc5-47c5-ac6a-da890a5c31d5\" (UID: \"7701ca21-4fc5-47c5-ac6a-da890a5c31d5\") "
Jul 17 22:35:22.047337 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.047316    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7701ca21-4fc5-47c5-ac6a-da890a5c31d5" (UID: "7701ca21-4fc5-47c5-ac6a-da890a5c31d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:22.148000 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.147962    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7701ca21-4fc5-47c5-ac6a-da890a5c31d5-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:22.735677 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.735648    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"
Jul 17 22:35:22.735677 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.735659    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v" event={"ID":"7701ca21-4fc5-47c5-ac6a-da890a5c31d5","Type":"ContainerDied","Data":"0fb5af1f9f971f803fb7f4d5266384b3e5c9daad81b7a9375e8e50e966479d97"}
Jul 17 22:35:22.735936 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.735728    2570 scope.go:117] "RemoveContainer" containerID="c4decfd89d437e6dcca73ef8fdac495551f09d280b0ab27da56b425f1f26f008"
Jul 17 22:35:22.756705 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.756675    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:22.761981 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:22.761956    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-9kd7v"]
Jul 17 22:35:24.008629 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:24.008577    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" path="/var/lib/kubelet/pods/7701ca21-4fc5-47c5-ac6a-da890a5c31d5/volumes"
Jul 17 22:35:26.609210 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609176    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"]
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609488    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609499    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609511    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609516    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609528    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609535    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609548    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609553    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609560    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609594 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609565    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609627    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609636    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609642    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.609964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609648    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.609964 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.609653    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.617529 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.617513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:26.620844 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.620805    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"]
Jul 17 22:35:26.653435 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.653401    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:26.653773 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.653760    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.653816 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.653775    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d549d0e4-ca74-4161-b2c2-9bea306a021a" containerName="revoke-keys"
Jul 17 22:35:26.653860 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.653848    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7701ca21-4fc5-47c5-ac6a-da890a5c31d5" containerName="revoke-keys"
Jul 17 22:35:26.657205 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.657190    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:26.674682 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.674649    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:26.677905 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.677878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w\" (UID: \"0cde7473-12d9-4257-b59c-708a7367cbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:26.779132 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.779093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w\" (UID: \"0cde7473-12d9-4257-b59c-708a7367cbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:26.779314 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.779170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j\" (UID: \"13707683-2723-4e30-b810-57bbeb0e9e86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:26.779805 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.779776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w\" (UID: \"0cde7473-12d9-4257-b59c-708a7367cbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:26.880183 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.880099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j\" (UID: \"13707683-2723-4e30-b810-57bbeb0e9e86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:26.880817 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.880792    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j\" (UID: \"13707683-2723-4e30-b810-57bbeb0e9e86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:26.930204 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.930169    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:26.966807 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:26.966774    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:27.084952 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.084899    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"]
Jul 17 22:35:27.088006 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:27.087982    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cde7473_12d9_4257_b59c_708a7367cbcc.slice/crio-ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054 WatchSource:0}: Error finding container ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054: Status 404 returned error can't find the container with id ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054
Jul 17 22:35:27.128490 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.128467    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:27.130071 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:27.130049    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13707683_2723_4e30_b810_57bbeb0e9e86.slice/crio-4c7153afcbb1242552adac8d02bc1021c0698db1b4ea98577e637374187f010b WatchSource:0}: Error finding container 4c7153afcbb1242552adac8d02bc1021c0698db1b4ea98577e637374187f010b: Status 404 returned error can't find the container with id 4c7153afcbb1242552adac8d02bc1021c0698db1b4ea98577e637374187f010b
Jul 17 22:35:27.768075 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.767982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerStarted","Data":"98c5b8ae9ac690b0d9813196707c1791220b023ba62ee546e5f22e756dd6797c"}
Jul 17 22:35:27.768075 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.768040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerStarted","Data":"4c7153afcbb1242552adac8d02bc1021c0698db1b4ea98577e637374187f010b"}
Jul 17 22:35:27.769432 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.769410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w" event={"ID":"0cde7473-12d9-4257-b59c-708a7367cbcc","Type":"ContainerStarted","Data":"9ed02318265b480bbb78b03feb195f64720d2a8f1d6cb32beec27d929677c60f"}
Jul 17 22:35:27.769539 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.769450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w" event={"ID":"0cde7473-12d9-4257-b59c-708a7367cbcc","Type":"ContainerStarted","Data":"ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054"}
Jul 17 22:35:27.789493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.789442    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" podStartSLOduration=1.789429334 podStartE2EDuration="1.789429334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:35:27.787642153 +0000 UTC m=+2996.266594709" watchObservedRunningTime="2026-07-17 22:35:27.789429334 +0000 UTC m=+2996.268381890"
Jul 17 22:35:27.805558 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:27.805509    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w" podStartSLOduration=1.8054919630000001 podStartE2EDuration="1.805491963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:35:27.804734482 +0000 UTC m=+2996.283687061" watchObservedRunningTime="2026-07-17 22:35:27.805491963 +0000 UTC m=+2996.284444519"
Jul 17 22:35:28.009365 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.009338    2570 scope.go:117] "RemoveContainer" containerID="84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f"
Jul 17 22:35:28.776993 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.776959    2570 generic.go:356] "Generic (PLEG): container finished" podID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerID="65ffab0a309469c710c6ef794a268ad19c5fce28a138a193fe8aa1618b51cd92" exitCode=6
Jul 17 22:35:28.777426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.777043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" event={"ID":"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab","Type":"ContainerDied","Data":"65ffab0a309469c710c6ef794a268ad19c5fce28a138a193fe8aa1618b51cd92"}
Jul 17 22:35:28.777426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.777100    2570 scope.go:117] "RemoveContainer" containerID="84f9610783cc760590480683dfa1c120ce7e58123a54e3d40e537917412c670f"
Jul 17 22:35:28.777426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.777398    2570 scope.go:117] "RemoveContainer" containerID="65ffab0a309469c710c6ef794a268ad19c5fce28a138a193fe8aa1618b51cd92"
Jul 17 22:35:28.777686 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:28.777660    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd_odh-ai-gateway-infra(0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab"
Jul 17 22:35:28.778938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.778918    2570 generic.go:356] "Generic (PLEG): container finished" podID="13707683-2723-4e30-b810-57bbeb0e9e86" containerID="98c5b8ae9ac690b0d9813196707c1791220b023ba62ee546e5f22e756dd6797c" exitCode=6
Jul 17 22:35:28.779035 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.778984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerDied","Data":"98c5b8ae9ac690b0d9813196707c1791220b023ba62ee546e5f22e756dd6797c"}
Jul 17 22:35:28.779160 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.779146    2570 scope.go:117] "RemoveContainer" containerID="98c5b8ae9ac690b0d9813196707c1791220b023ba62ee546e5f22e756dd6797c"
Jul 17 22:35:28.780473 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.780456    2570 generic.go:356] "Generic (PLEG): container finished" podID="0cde7473-12d9-4257-b59c-708a7367cbcc" containerID="9ed02318265b480bbb78b03feb195f64720d2a8f1d6cb32beec27d929677c60f" exitCode=0
Jul 17 22:35:28.780572 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:28.780494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w" event={"ID":"0cde7473-12d9-4257-b59c-708a7367cbcc","Type":"ContainerDied","Data":"9ed02318265b480bbb78b03feb195f64720d2a8f1d6cb32beec27d929677c60f"}
Jul 17 22:35:29.789358 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.789318    2570 generic.go:356] "Generic (PLEG): container finished" podID="13707683-2723-4e30-b810-57bbeb0e9e86" containerID="71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1" exitCode=6
Jul 17 22:35:29.789828 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.789399    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerDied","Data":"71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1"}
Jul 17 22:35:29.789828 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.789460    2570 scope.go:117] "RemoveContainer" containerID="98c5b8ae9ac690b0d9813196707c1791220b023ba62ee546e5f22e756dd6797c"
Jul 17 22:35:29.789828 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.789675    2570 scope.go:117] "RemoveContainer" containerID="71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1"
Jul 17 22:35:29.790087 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:29.789901    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j_odh-ai-gateway-infra(13707683-2723-4e30-b810-57bbeb0e9e86)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" podUID="13707683-2723-4e30-b810-57bbeb0e9e86"
Jul 17 22:35:29.806399 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.806368    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:29.946987 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.946958    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:29.989427 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:29.989395    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:30.002500 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.002468    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca\") pod \"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab\" (UID: \"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab\") "
Jul 17 22:35:30.002674 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.002555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca\") pod \"0cde7473-12d9-4257-b59c-708a7367cbcc\" (UID: \"0cde7473-12d9-4257-b59c-708a7367cbcc\") "
Jul 17 22:35:30.002894 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.002871    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0cde7473-12d9-4257-b59c-708a7367cbcc" (UID: "0cde7473-12d9-4257-b59c-708a7367cbcc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:30.002949 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.002888    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" (UID: "0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:30.103916 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.103819    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:30.103916 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.103854    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cde7473-12d9-4257-b59c-708a7367cbcc-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:30.796721 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.796692    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"
Jul 17 22:35:30.797135 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.796732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd" event={"ID":"0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab","Type":"ContainerDied","Data":"70760ee675b5f530619c6429f00d84f13bd815d8d8c82d559c8b7d0fc17f2b30"}
Jul 17 22:35:30.797135 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.796799    2570 scope.go:117] "RemoveContainer" containerID="65ffab0a309469c710c6ef794a268ad19c5fce28a138a193fe8aa1618b51cd92"
Jul 17 22:35:30.798726 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.798697    2570 scope.go:117] "RemoveContainer" containerID="71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1"
Jul 17 22:35:30.798966 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:30.798938    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j_odh-ai-gateway-infra(13707683-2723-4e30-b810-57bbeb0e9e86)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" podUID="13707683-2723-4e30-b810-57bbeb0e9e86"
Jul 17 22:35:30.799988 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.799966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w" event={"ID":"0cde7473-12d9-4257-b59c-708a7367cbcc","Type":"ContainerDied","Data":"ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054"}
Jul 17 22:35:30.800073 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.800003    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea5c8a4983e51dccc27982ee81158e369860f918f88a1a238c3af0e7f611d054"
Jul 17 22:35:30.800073 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.799971    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w"
Jul 17 22:35:30.832875 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.832840    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:30.844453 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:30.844416    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-qq8rd"]
Jul 17 22:35:32.010838 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:32.010808    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" path="/var/lib/kubelet/pods/0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab/volumes"
Jul 17 22:35:32.238305 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:32.238281    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:35:32.246151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:32.246120    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:35:37.461427 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.461395    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:35:37.462002 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.461585    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerName="maas-api" containerID="cri-o://09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f" gracePeriod=30
Jul 17 22:35:37.538044 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.537998    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.49:8443/health\": dial tcp 10.132.0.49:8443: connect: connection refused"
Jul 17 22:35:37.714816 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.714752    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:35:37.763106 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.763079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca\") pod \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") "
Jul 17 22:35:37.763270 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.763146    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") pod \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") "
Jul 17 22:35:37.763332 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.763310    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhghg\" (UniqueName: \"kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg\") pod \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\" (UID: \"465c21d7-213d-43a3-a7cf-43e3b5c782b6\") "
Jul 17 22:35:37.763491 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.763463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "465c21d7-213d-43a3-a7cf-43e3b5c782b6" (UID: "465c21d7-213d-43a3-a7cf-43e3b5c782b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:37.763568 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.763535    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465c21d7-213d-43a3-a7cf-43e3b5c782b6-openshift-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:37.765481 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.765458    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "465c21d7-213d-43a3-a7cf-43e3b5c782b6" (UID: "465c21d7-213d-43a3-a7cf-43e3b5c782b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:35:37.765601 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.765526    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg" (OuterVolumeSpecName: "kube-api-access-zhghg") pod "465c21d7-213d-43a3-a7cf-43e3b5c782b6" (UID: "465c21d7-213d-43a3-a7cf-43e3b5c782b6"). InnerVolumeSpecName "kube-api-access-zhghg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:35:37.840516 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.840478    2570 generic.go:356] "Generic (PLEG): container finished" podID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerID="09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f" exitCode=0
Jul 17 22:35:37.840710 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.840539    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"
Jul 17 22:35:37.840710 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.840569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" event={"ID":"465c21d7-213d-43a3-a7cf-43e3b5c782b6","Type":"ContainerDied","Data":"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"}
Jul 17 22:35:37.840710 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.840656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx" event={"ID":"465c21d7-213d-43a3-a7cf-43e3b5c782b6","Type":"ContainerDied","Data":"217d8e016338c7cd5cb393a57fe55099107a5cacb9450b44cbfa1635f6c8122d"}
Jul 17 22:35:37.840710 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.840686    2570 scope.go:117] "RemoveContainer" containerID="09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"
Jul 17 22:35:37.849841 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.849822    2570 scope.go:117] "RemoveContainer" containerID="09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"
Jul 17 22:35:37.850115 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:37.850097    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f\": container with ID starting with 09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f not found: ID does not exist" containerID="09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"
Jul 17 22:35:37.850159 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.850126    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f"} err="failed to get container status \"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f\": rpc error: code = NotFound desc = could not find container \"09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f\": container with ID starting with 09a33cba96849c8f26075d0adeaad116056905937f55f9ee1965f9004490cc4f not found: ID does not exist"
Jul 17 22:35:37.862545 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.862512    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:35:37.864592 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.864571    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465c21d7-213d-43a3-a7cf-43e3b5c782b6-maas-api-tls\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:37.864664 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.864596    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhghg\" (UniqueName: \"kubernetes.io/projected/465c21d7-213d-43a3-a7cf-43e3b5c782b6-kube-api-access-zhghg\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:37.869077 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:37.869052    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bf8fd3-7c47588b55-zlqvx"]
Jul 17 22:35:38.008127 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:38.008045    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" path="/var/lib/kubelet/pods/465c21d7-213d-43a3-a7cf-43e3b5c782b6/volumes"
Jul 17 22:35:44.002841 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:44.002806    2570 scope.go:117] "RemoveContainer" containerID="71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1"
Jul 17 22:35:44.878488 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:44.878455    2570 generic.go:356] "Generic (PLEG): container finished" podID="13707683-2723-4e30-b810-57bbeb0e9e86" containerID="c93f71d4039dbeb8e3dc63910fbc3556cfe26b63008b6d33e7032ea6b7275410" exitCode=6
Jul 17 22:35:44.878681 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:44.878530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerDied","Data":"c93f71d4039dbeb8e3dc63910fbc3556cfe26b63008b6d33e7032ea6b7275410"}
Jul 17 22:35:44.878681 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:44.878594    2570 scope.go:117] "RemoveContainer" containerID="71c703833a7c4ad0b4c7c19c0df8e06f1fa6fbfc33d7e5ec3194cfb04b7256e1"
Jul 17 22:35:44.878893 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:44.878870    2570 scope.go:117] "RemoveContainer" containerID="c93f71d4039dbeb8e3dc63910fbc3556cfe26b63008b6d33e7032ea6b7275410"
Jul 17 22:35:44.879117 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:44.879095    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j_odh-ai-gateway-infra(13707683-2723-4e30-b810-57bbeb0e9e86)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" podUID="13707683-2723-4e30-b810-57bbeb0e9e86"
Jul 17 22:35:45.904797 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:45.904760    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:46.036347 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.036320    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:46.133334 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.133304    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca\") pod \"13707683-2723-4e30-b810-57bbeb0e9e86\" (UID: \"13707683-2723-4e30-b810-57bbeb0e9e86\") "
Jul 17 22:35:46.133694 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.133672    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13707683-2723-4e30-b810-57bbeb0e9e86" (UID: "13707683-2723-4e30-b810-57bbeb0e9e86"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:35:46.234220 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.234140    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13707683-2723-4e30-b810-57bbeb0e9e86-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:35:46.898473 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.898437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j" event={"ID":"13707683-2723-4e30-b810-57bbeb0e9e86","Type":"ContainerDied","Data":"4c7153afcbb1242552adac8d02bc1021c0698db1b4ea98577e637374187f010b"}
Jul 17 22:35:46.898473 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.898468    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"
Jul 17 22:35:46.898745 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.898525    2570 scope.go:117] "RemoveContainer" containerID="c93f71d4039dbeb8e3dc63910fbc3556cfe26b63008b6d33e7032ea6b7275410"
Jul 17 22:35:46.921280 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.921253    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:46.926083 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:46.926058    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09e18326-c8g4j"]
Jul 17 22:35:48.008661 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:48.008596    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" path="/var/lib/kubelet/pods/13707683-2723-4e30-b810-57bbeb0e9e86/volumes"
Jul 17 22:35:55.152420 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152388    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152715    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerName="maas-api"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152726    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerName="maas-api"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152734    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152741    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152749    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152755    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152762    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152769    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152779    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cde7473-12d9-4257-b59c-708a7367cbcc" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152783    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cde7473-12d9-4257-b59c-708a7367cbcc" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152789    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152794    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152847    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cde7473-12d9-4257-b59c-708a7367cbcc" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152856    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152861    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152866    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="465c21d7-213d-43a3-a7cf-43e3b5c782b6" containerName="maas-api"
Jul 17 22:35:55.152863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152873    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.153371 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152878    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:55.153371 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.152883    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:55.157021 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.157003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:35:55.159588 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.159567    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:35:55.159926 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.159910    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 22:35:55.164831 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.164789    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:35:55.205377 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.205336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-8996k\" (UID: \"5fa6d960-7c16-4be5-8077-457c561d963d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:35:55.306429 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.306393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-8996k\" (UID: \"5fa6d960-7c16-4be5-8077-457c561d963d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:35:55.307061 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.307034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45495ac6-8996k\" (UID: \"5fa6d960-7c16-4be5-8077-457c561d963d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:35:55.468185 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.468082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:35:55.603934 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.603907    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:35:55.605522 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:55.605497    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa6d960_7c16_4be5_8077_457c561d963d.slice/crio-ba3ee5bc1b0d157067a22d65179a2c5f020dc8773a2e584138559aabc84f22eb WatchSource:0}: Error finding container ba3ee5bc1b0d157067a22d65179a2c5f020dc8773a2e584138559aabc84f22eb: Status 404 returned error can't find the container with id ba3ee5bc1b0d157067a22d65179a2c5f020dc8773a2e584138559aabc84f22eb
Jul 17 22:35:55.950490 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.950446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerStarted","Data":"2af56147c2b5b666caee530516de79563b3ff39aa10c80107c853ce1b44002ec"}
Jul 17 22:35:55.950655 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.950521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerStarted","Data":"ba3ee5bc1b0d157067a22d65179a2c5f020dc8773a2e584138559aabc84f22eb"}
Jul 17 22:35:55.969865 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:55.969817    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" podStartSLOduration=0.969799383 podStartE2EDuration="969.799383ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:35:55.968749348 +0000 UTC m=+3024.447701905" watchObservedRunningTime="2026-07-17 22:35:55.969799383 +0000 UTC m=+3024.448751939"
Jul 17 22:35:56.546193 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546159    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:35:56.546698 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546680    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:56.546757 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546702    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:56.546757 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546721    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:56.546757 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546732    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="13707683-2723-4e30-b810-57bbeb0e9e86" containerName="revoke-keys"
Jul 17 22:35:56.546853 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.546814    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bce7ff2-0de9-48b1-a8d6-7d47e55aeeab" containerName="revoke-keys"
Jul 17 22:35:56.550252 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.550231    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.553429 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.553406    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vxq68\""
Jul 17 22:35:56.553429 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.553422    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 22:35:56.554066 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.554051    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a56653-serving-cert\""
Jul 17 22:35:56.564796 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.564757    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:35:56.618202 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.618168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.618202 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.618210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxj5r\" (UniqueName: \"kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.618442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.618248    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.719142 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.719103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.719142 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.719149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxj5r\" (UniqueName: \"kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.719372 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.719177    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.719372 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:56.719251    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-serving-cert: secret "maas-api-e2e-shared-a-a56653-serving-cert" not found
Jul 17 22:35:56.719372 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:56.719329    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls podName:2e1ea72d-c376-4f4c-8360-236aae90a518 nodeName:}" failed. No retries permitted until 2026-07-17 22:35:57.219309078 +0000 UTC m=+3025.698261639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls") pod "maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" (UID: "2e1ea72d-c376-4f4c-8360-236aae90a518") : secret "maas-api-e2e-shared-a-a56653-serving-cert" not found
Jul 17 22:35:56.719795 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.719778    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.730367 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.730336    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxj5r\" (UniqueName: \"kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:56.957788 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.957695    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa6d960-7c16-4be5-8077-457c561d963d" containerID="2af56147c2b5b666caee530516de79563b3ff39aa10c80107c853ce1b44002ec" exitCode=6
Jul 17 22:35:56.957939 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.957782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerDied","Data":"2af56147c2b5b666caee530516de79563b3ff39aa10c80107c853ce1b44002ec"}
Jul 17 22:35:56.957939 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:56.957916    2570 scope.go:117] "RemoveContainer" containerID="2af56147c2b5b666caee530516de79563b3ff39aa10c80107c853ce1b44002ec"
Jul 17 22:35:57.223075 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.222990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:57.225578 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.225549    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") pod \"maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:57.460451 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.460415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:57.600055 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.600026    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:35:57.601571 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:35:57.601544    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1ea72d_c376_4f4c_8360_236aae90a518.slice/crio-98968957ef2367eb96734ebf634259772994c0a41a17293216c84986b6bf82ff WatchSource:0}: Error finding container 98968957ef2367eb96734ebf634259772994c0a41a17293216c84986b6bf82ff: Status 404 returned error can't find the container with id 98968957ef2367eb96734ebf634259772994c0a41a17293216c84986b6bf82ff
Jul 17 22:35:57.965048 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.965011    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" event={"ID":"2e1ea72d-c376-4f4c-8360-236aae90a518","Type":"ContainerStarted","Data":"98968957ef2367eb96734ebf634259772994c0a41a17293216c84986b6bf82ff"}
Jul 17 22:35:57.966700 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.966677    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa6d960-7c16-4be5-8077-457c561d963d" containerID="5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0" exitCode=6
Jul 17 22:35:57.966808 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.966722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerDied","Data":"5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0"}
Jul 17 22:35:57.966808 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.966767    2570 scope.go:117] "RemoveContainer" containerID="2af56147c2b5b666caee530516de79563b3ff39aa10c80107c853ce1b44002ec"
Jul 17 22:35:57.967032 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:57.967015    2570 scope.go:117] "RemoveContainer" containerID="5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0"
Jul 17 22:35:57.967244 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:57.967222    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-8996k_odh-ai-gateway-infra(5fa6d960-7c16-4be5-8077-457c561d963d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" podUID="5fa6d960-7c16-4be5-8077-457c561d963d"
Jul 17 22:35:58.973214 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:58.973169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" event={"ID":"2e1ea72d-c376-4f4c-8360-236aae90a518","Type":"ContainerStarted","Data":"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"}
Jul 17 22:35:58.973738 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:58.973247    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:35:58.974999 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:58.974981    2570 scope.go:117] "RemoveContainer" containerID="5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0"
Jul 17 22:35:58.975159 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:35:58.975142    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-8996k_odh-ai-gateway-infra(5fa6d960-7c16-4be5-8077-457c561d963d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" podUID="5fa6d960-7c16-4be5-8077-457c561d963d"
Jul 17 22:35:58.992225 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:35:58.992179    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" podStartSLOduration=2.61723547 podStartE2EDuration="2.99216344s" totalImagesPullingTime="374.92797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:35:58.990550386 +0000 UTC m=+3027.469502952" watchObservedRunningTime="2026-07-17 22:35:58.99216344 +0000 UTC m=+3027.471115995"
Jul 17 22:36:03.072173 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.072140    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:03.075790 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.075770    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:03.090552 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.090523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:03.171063 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.171029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-kx72c\" (UID: \"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:03.272544 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.272503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-kx72c\" (UID: \"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:03.273221 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.273198    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-kx72c\" (UID: \"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:03.389050 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.388967    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:03.527940 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:03.527917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:03.530074 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:36:03.530049    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa7a9f8_f526_4fc1_8745_3261c5da1b2d.slice/crio-6a2ca3e783d17fb55d9c0366933921d65a566fbebae4feac26ef2dd7ca4dc94b WatchSource:0}: Error finding container 6a2ca3e783d17fb55d9c0366933921d65a566fbebae4feac26ef2dd7ca4dc94b: Status 404 returned error can't find the container with id 6a2ca3e783d17fb55d9c0366933921d65a566fbebae4feac26ef2dd7ca4dc94b
Jul 17 22:36:04.008346 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.008262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerStarted","Data":"63652a8065bea4fff880f83a742fa13ea8c3e321fc0ad2b7ac4fd0bbaad3148f"}
Jul 17 22:36:04.008346 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.008315    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerStarted","Data":"6a2ca3e783d17fb55d9c0366933921d65a566fbebae4feac26ef2dd7ca4dc94b"}
Jul 17 22:36:04.020855 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.020798    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" podStartSLOduration=1.020783028 podStartE2EDuration="1.020783028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:36:04.019685351 +0000 UTC m=+3032.498637919" watchObservedRunningTime="2026-07-17 22:36:04.020783028 +0000 UTC m=+3032.499735584"
Jul 17 22:36:04.612037 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.611996    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:36:04.616419 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.616395    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.622515 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.622488    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-fb05ec-serving-cert\""
Jul 17 22:36:04.632711 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.632681    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:36:04.682316 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.682287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.682508 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.682331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.682508 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.682360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.783814 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.783769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.783974 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.783839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.783974 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.783939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.784064 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:04.784047    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-serving-cert: secret "maas-api-e2e-shared-b-fb05ec-serving-cert" not found
Jul 17 22:36:04.784130 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:04.784119    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls podName:81a0b367-da2d-47ba-9782-6fc08b539096 nodeName:}" failed. No retries permitted until 2026-07-17 22:36:05.284096926 +0000 UTC m=+3033.763049461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls") pod "maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" (UID: "81a0b367-da2d-47ba-9782-6fc08b539096") : secret "maas-api-e2e-shared-b-fb05ec-serving-cert" not found
Jul 17 22:36:04.784526 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.784507    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.803884 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.803852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:04.986239 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:04.986166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:36:05.010077 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.010041    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerID="63652a8065bea4fff880f83a742fa13ea8c3e321fc0ad2b7ac4fd0bbaad3148f" exitCode=6
Jul 17 22:36:05.010238 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.010128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerDied","Data":"63652a8065bea4fff880f83a742fa13ea8c3e321fc0ad2b7ac4fd0bbaad3148f"}
Jul 17 22:36:05.010313 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.010301    2570 scope.go:117] "RemoveContainer" containerID="63652a8065bea4fff880f83a742fa13ea8c3e321fc0ad2b7ac4fd0bbaad3148f"
Jul 17 22:36:05.288194 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.288159    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:05.290876 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.290854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") pod \"maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:05.527987 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.527891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:05.671481 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:05.671457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:36:05.673175 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:36:05.673149    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a0b367_da2d_47ba_9782_6fc08b539096.slice/crio-1054696a75f298161b701546c9fb088e73d38eef652bb9638ce65e152406d57f WatchSource:0}: Error finding container 1054696a75f298161b701546c9fb088e73d38eef652bb9638ce65e152406d57f: Status 404 returned error can't find the container with id 1054696a75f298161b701546c9fb088e73d38eef652bb9638ce65e152406d57f
Jul 17 22:36:06.017347 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:06.017315    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerID="3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132" exitCode=6
Jul 17 22:36:06.017492 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:06.017400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerDied","Data":"3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132"}
Jul 17 22:36:06.017492 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:06.017472    2570 scope.go:117] "RemoveContainer" containerID="63652a8065bea4fff880f83a742fa13ea8c3e321fc0ad2b7ac4fd0bbaad3148f"
Jul 17 22:36:06.017761 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:06.017742    2570 scope.go:117] "RemoveContainer" containerID="3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132"
Jul 17 22:36:06.018034 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:06.018002    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-kx72c_odh-ai-gateway-infra(5fa7a9f8-f526-4fc1-8745-3261c5da1b2d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d"
Jul 17 22:36:06.019188 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:06.019166    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" event={"ID":"81a0b367-da2d-47ba-9782-6fc08b539096","Type":"ContainerStarted","Data":"1054696a75f298161b701546c9fb088e73d38eef652bb9638ce65e152406d57f"}
Jul 17 22:36:07.026496 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:07.026465    2570 scope.go:117] "RemoveContainer" containerID="3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132"
Jul 17 22:36:07.026963 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:07.026705    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-kx72c_odh-ai-gateway-infra(5fa7a9f8-f526-4fc1-8745-3261c5da1b2d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d"
Jul 17 22:36:07.027774 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:07.027752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" event={"ID":"81a0b367-da2d-47ba-9782-6fc08b539096","Type":"ContainerStarted","Data":"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"}
Jul 17 22:36:07.027898 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:07.027814    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:07.068917 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:07.068866    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" podStartSLOduration=2.793905269 podStartE2EDuration="3.06885092s" totalImagesPullingTime="274.945651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:36:07.066391056 +0000 UTC m=+3035.545343611" watchObservedRunningTime="2026-07-17 22:36:07.06885092 +0000 UTC m=+3035.547803476"
Jul 17 22:36:12.006256 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:12.006206    2570 scope.go:117] "RemoveContainer" containerID="5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0"
Jul 17 22:36:13.042008 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:13.041981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:36:13.063229 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:13.063198    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa6d960-7c16-4be5-8077-457c561d963d" containerID="88ee247cd96c822d48619003c814ea88f8251e64ada5842435a985ee136f93b4" exitCode=6
Jul 17 22:36:13.063392 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:13.063274    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerDied","Data":"88ee247cd96c822d48619003c814ea88f8251e64ada5842435a985ee136f93b4"}
Jul 17 22:36:13.063392 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:13.063354    2570 scope.go:117] "RemoveContainer" containerID="5c71e04bfc3ab7f3eeac727d5e4c893b9736c7f6e68d9c1b83c51bb6b7c373f0"
Jul 17 22:36:13.063755 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:13.063737    2570 scope.go:117] "RemoveContainer" containerID="88ee247cd96c822d48619003c814ea88f8251e64ada5842435a985ee136f93b4"
Jul 17 22:36:13.064015 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:13.063988    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-45495ac6-8996k_odh-ai-gateway-infra(5fa6d960-7c16-4be5-8077-457c561d963d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" podUID="5fa6d960-7c16-4be5-8077-457c561d963d"
Jul 17 22:36:14.091836 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:14.091800    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:36:14.223876 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:14.223851    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:36:14.368403 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:14.368305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca\") pod \"5fa6d960-7c16-4be5-8077-457c561d963d\" (UID: \"5fa6d960-7c16-4be5-8077-457c561d963d\") "
Jul 17 22:36:14.368807 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:14.368779    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fa6d960-7c16-4be5-8077-457c561d963d" (UID: "5fa6d960-7c16-4be5-8077-457c561d963d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:36:14.469126 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:14.469091    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa6d960-7c16-4be5-8077-457c561d963d-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:36:15.076876 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:15.076843    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"
Jul 17 22:36:15.076876 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:15.076864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k" event={"ID":"5fa6d960-7c16-4be5-8077-457c561d963d","Type":"ContainerDied","Data":"ba3ee5bc1b0d157067a22d65179a2c5f020dc8773a2e584138559aabc84f22eb"}
Jul 17 22:36:15.077138 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:15.076927    2570 scope.go:117] "RemoveContainer" containerID="88ee247cd96c822d48619003c814ea88f8251e64ada5842435a985ee136f93b4"
Jul 17 22:36:15.098699 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:15.098673    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:36:15.104550 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:15.104530    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45495ac6-8996k"]
Jul 17 22:36:16.008973 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.008941    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" path="/var/lib/kubelet/pods/5fa6d960-7c16-4be5-8077-457c561d963d/volumes"
Jul 17 22:36:16.425966 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.425932    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:36:16.434201 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434166    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434201 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434199    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434432 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434225    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434432 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434249    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434432 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434267    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434432 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434275    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434731 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434708    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.434835 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.434741    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:16.438975 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.438956    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.441814 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.441792    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"openshift-service-ca.crt\""
Jul 17 22:36:16.442746 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.442715    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"auth-test-model-a56653-kserve-self-signed-certs\""
Jul 17 22:36:16.442860 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.442763    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"kube-root-ca.crt\""
Jul 17 22:36:16.442860 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.442718    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"default-dockercfg-vndmd\""
Jul 17 22:36:16.443475 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.443454    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:36:16.587442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bd64\" (UniqueName: \"kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.587657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.587657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.587657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.587657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.587657 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.587556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688499 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bd64\" (UniqueName: \"kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688499 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688499 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688499 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688893 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.688893 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.689005 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.688976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.689059 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.689005    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.689059 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.689035    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.691121 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.691100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.691238 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.691228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.696846 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.696820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bd64\" (UniqueName: \"kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64\") pod \"auth-test-model-a56653-kserve-5d6cb7d995-qzhs6\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") " pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.749740 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.749700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:16.892625 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:16.892584    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:36:16.894457 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:36:16.894430    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76d03c40_54dd_43e9_a54a_130cc980b293.slice/crio-b185c8e0c63974dac64bd8354e40af489f989ed69d15851b0b10cce2a874713c WatchSource:0}: Error finding container b185c8e0c63974dac64bd8354e40af489f989ed69d15851b0b10cce2a874713c: Status 404 returned error can't find the container with id b185c8e0c63974dac64bd8354e40af489f989ed69d15851b0b10cce2a874713c
Jul 17 22:36:17.090064 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:17.090026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" event={"ID":"76d03c40-54dd-43e9-a54a-130cc980b293","Type":"ContainerStarted","Data":"7e37abc8f86a5e76012babd7e53b6a73349ed337dbc84e35b1605b3e5642556e"}
Jul 17 22:36:17.090255 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:17.090078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" event={"ID":"76d03c40-54dd-43e9-a54a-130cc980b293","Type":"ContainerStarted","Data":"b185c8e0c63974dac64bd8354e40af489f989ed69d15851b0b10cce2a874713c"}
Jul 17 22:36:17.112410 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:17.112350    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" podStartSLOduration=1.112333824 podStartE2EDuration="1.112333824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:36:17.109414846 +0000 UTC m=+3045.588367403" watchObservedRunningTime="2026-07-17 22:36:17.112333824 +0000 UTC m=+3045.591286379"
Jul 17 22:36:20.003028 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:20.002987    2570 scope.go:117] "RemoveContainer" containerID="3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132"
Jul 17 22:36:21.114819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:21.114790    2570 generic.go:356] "Generic (PLEG): container finished" podID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerID="6ac878e4646ee05c5764891bb990a52e344b0e22f98b0deb9942f7267a7a244f" exitCode=6
Jul 17 22:36:21.115225 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:21.114866    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerDied","Data":"6ac878e4646ee05c5764891bb990a52e344b0e22f98b0deb9942f7267a7a244f"}
Jul 17 22:36:21.115225 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:21.114929    2570 scope.go:117] "RemoveContainer" containerID="3a8eef6e6a96e05fb7d9ca81f4be484f1e1d077ba8ebd396ccda3f7a20674132"
Jul 17 22:36:21.115327 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:21.115312    2570 scope.go:117] "RemoveContainer" containerID="6ac878e4646ee05c5764891bb990a52e344b0e22f98b0deb9942f7267a7a244f"
Jul 17 22:36:21.115543 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:36:21.115518    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-kx72c_odh-ai-gateway-infra(5fa7a9f8-f526-4fc1-8745-3261c5da1b2d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d"
Jul 17 22:36:22.141950 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:22.141914    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:22.276517 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:22.276489    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:22.442323 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:22.442234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca\") pod \"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d\" (UID: \"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d\") "
Jul 17 22:36:22.442592 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:22.442570    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" (UID: "5fa7a9f8-f526-4fc1-8745-3261c5da1b2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:36:22.543545 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:22.543503    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:36:23.129726 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:23.129641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c" event={"ID":"5fa7a9f8-f526-4fc1-8745-3261c5da1b2d","Type":"ContainerDied","Data":"6a2ca3e783d17fb55d9c0366933921d65a566fbebae4feac26ef2dd7ca4dc94b"}
Jul 17 22:36:23.129726 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:23.129689    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"
Jul 17 22:36:23.129726 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:23.129717    2570 scope.go:117] "RemoveContainer" containerID="6ac878e4646ee05c5764891bb990a52e344b0e22f98b0deb9942f7267a7a244f"
Jul 17 22:36:23.154428 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:23.154397    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:23.162176 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:23.162149    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-kx72c"]
Jul 17 22:36:24.008840 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:24.008807    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" path="/var/lib/kubelet/pods/5fa7a9f8-f526-4fc1-8745-3261c5da1b2d/volumes"
Jul 17 22:36:26.750296 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:26.750263    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:26.750706 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:26.750351    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:26.762948 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:26.762919    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:27.162758 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:27.162728    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:36:41.342958 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.342926    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:36:41.343325 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343282    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343325 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343293    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343325 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343302    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343325 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343308    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343467 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343371    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343467 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343378    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343467 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343385    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:36:41.343467 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.343394    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa6d960-7c16-4be5-8077-457c561d963d" containerName="revoke-keys"
Jul 17 22:36:41.347908 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.347890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.350728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.350708    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"default-dockercfg-8cnmk\""
Jul 17 22:36:41.351471 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.351451    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"auth-test-model-fb05ec-kserve-self-signed-certs\""
Jul 17 22:36:41.351581 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.351488    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"kube-root-ca.crt\""
Jul 17 22:36:41.351581 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.351488    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"openshift-service-ca.crt\""
Jul 17 22:36:41.358997 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.358973    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:36:41.408120 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408083    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.408271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.408271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.408271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d495j\" (UniqueName: \"kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.408271 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.408423 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.408278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509588 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509829 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509829 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509829 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d495j\" (UniqueName: \"kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509829 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.509829 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.510087 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.509982    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.510087 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.510057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.510208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.510143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.512125 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.512101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.512300 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.512284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.517873 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.517854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d495j\" (UniqueName: \"kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j\") pod \"auth-test-model-fb05ec-kserve-6bd5794c7f-974lj\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") " pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.657792 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.657689    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:41.801330 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:41.801305    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:36:41.803283 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:36:41.803257    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc61da0e_e7f8_4b1d_8efd_d44f7370929c.slice/crio-1dbf2eb4d3084e60153e3331489443ff39501bb29c131803e98d5ae3135ec16c WatchSource:0}: Error finding container 1dbf2eb4d3084e60153e3331489443ff39501bb29c131803e98d5ae3135ec16c: Status 404 returned error can't find the container with id 1dbf2eb4d3084e60153e3331489443ff39501bb29c131803e98d5ae3135ec16c
Jul 17 22:36:42.229670 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:42.229630    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" event={"ID":"dc61da0e-e7f8-4b1d-8efd-d44f7370929c","Type":"ContainerStarted","Data":"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"}
Jul 17 22:36:42.229857 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:42.229681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" event={"ID":"dc61da0e-e7f8-4b1d-8efd-d44f7370929c","Type":"ContainerStarted","Data":"1dbf2eb4d3084e60153e3331489443ff39501bb29c131803e98d5ae3135ec16c"}
Jul 17 22:36:42.250383 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:42.250323    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" podStartSLOduration=1.250307198 podStartE2EDuration="1.250307198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:36:42.247394319 +0000 UTC m=+3070.726346894" watchObservedRunningTime="2026-07-17 22:36:42.250307198 +0000 UTC m=+3070.729259753"
Jul 17 22:36:51.658442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:51.658403    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:51.658901 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:51.658647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:51.670985 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:51.670964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:36:52.295834 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:36:52.295802    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:38:43.710956 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:43.710917    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:38:44.657090 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:44.657056    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:38:51.833336 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.833296    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:38:51.833859 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.833838    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:38:51.834149 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.833864    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa7a9f8-f526-4fc1-8745-3261c5da1b2d" containerName="revoke-keys"
Jul 17 22:38:51.837351 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.837329    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.839750 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.839727    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"sub-test-model-a56653-kserve-self-signed-certs\""
Jul 17 22:38:51.844470 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.844441    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:38:51.991470 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.991470 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljw9l\" (UniqueName: \"kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.991728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.991728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.991728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:51.991728 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:51.991662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092245 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092245 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljw9l\" (UniqueName: \"kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092245 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092567 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092567 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092567 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092783 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092690    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092783 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.092783 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.092763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.094817 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.094784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.094944 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.094911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.102503 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.102485    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljw9l\" (UniqueName: \"kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l\") pod \"sub-test-model-a56653-kserve-6448bcf87f-hxk5k\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") " pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.148508 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.148471    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:38:52.284677 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.284648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:38:52.286556 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:38:52.286533    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1f184e2_6f13_4d36_b052_f6dd46daed26.slice/crio-815b7a02261c3109462f686f06605fa445a67f49fe989b48c155c9a99adb9567 WatchSource:0}: Error finding container 815b7a02261c3109462f686f06605fa445a67f49fe989b48c155c9a99adb9567: Status 404 returned error can't find the container with id 815b7a02261c3109462f686f06605fa445a67f49fe989b48c155c9a99adb9567
Jul 17 22:38:52.923356 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.923310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" event={"ID":"b1f184e2-6f13-4d36-b052-f6dd46daed26","Type":"ContainerStarted","Data":"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"}
Jul 17 22:38:52.923776 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.923368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" event={"ID":"b1f184e2-6f13-4d36-b052-f6dd46daed26","Type":"ContainerStarted","Data":"815b7a02261c3109462f686f06605fa445a67f49fe989b48c155c9a99adb9567"}
Jul 17 22:38:52.941416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:52.941365    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" podStartSLOduration=1.941347819 podStartE2EDuration="1.941347819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:38:52.940993726 +0000 UTC m=+3201.419946302" watchObservedRunningTime="2026-07-17 22:38:52.941347819 +0000 UTC m=+3201.420300375"
Jul 17 22:38:58.732989 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:58.732930    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" podUID="76d03c40-54dd-43e9-a54a-130cc980b293" containerName="main" containerID="cri-o://7e37abc8f86a5e76012babd7e53b6a73349ed337dbc84e35b1605b3e5642556e" gracePeriod=45
Jul 17 22:38:58.958023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:58.957993    2570 generic.go:356] "Generic (PLEG): container finished" podID="76d03c40-54dd-43e9-a54a-130cc980b293" containerID="7e37abc8f86a5e76012babd7e53b6a73349ed337dbc84e35b1605b3e5642556e" exitCode=0
Jul 17 22:38:58.958209 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:58.958076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" event={"ID":"76d03c40-54dd-43e9-a54a-130cc980b293","Type":"ContainerDied","Data":"7e37abc8f86a5e76012babd7e53b6a73349ed337dbc84e35b1605b3e5642556e"}
Jul 17 22:38:58.984090 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:58.984020    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:38:59.157285 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157253    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157487 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157304    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157487 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157332    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bd64\" (UniqueName: \"kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157487 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157402    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157487 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157423    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157487 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157455    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache\") pod \"76d03c40-54dd-43e9-a54a-130cc980b293\" (UID: \"76d03c40-54dd-43e9-a54a-130cc980b293\") "
Jul 17 22:38:59.157791 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157587    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home" (OuterVolumeSpecName: "home") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:38:59.157791 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157603    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:38:59.157899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157854    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.157899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache" (OuterVolumeSpecName: "model-cache") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:38:59.157899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.157872    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.159842 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.159819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm" (OuterVolumeSpecName: "dshm") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:38:59.159930 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.159880    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:38:59.159992 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.159974    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64" (OuterVolumeSpecName: "kube-api-access-5bd64") pod "76d03c40-54dd-43e9-a54a-130cc980b293" (UID: "76d03c40-54dd-43e9-a54a-130cc980b293"). InnerVolumeSpecName "kube-api-access-5bd64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:38:59.258883 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.258788    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.258883 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.258822    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d03c40-54dd-43e9-a54a-130cc980b293-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.258883 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.258837    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d03c40-54dd-43e9-a54a-130cc980b293-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.258883 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.258849    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bd64\" (UniqueName: \"kubernetes.io/projected/76d03c40-54dd-43e9-a54a-130cc980b293-kube-api-access-5bd64\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:38:59.678141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.678077    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" podUID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" containerName="main" containerID="cri-o://fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7" gracePeriod=45
Jul 17 22:38:59.936130 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.936061    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:38:59.964844 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.964807    2570 generic.go:356] "Generic (PLEG): container finished" podID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" containerID="fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7" exitCode=0
Jul 17 22:38:59.965013 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.964847    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"
Jul 17 22:38:59.965013 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.964882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" event={"ID":"dc61da0e-e7f8-4b1d-8efd-d44f7370929c","Type":"ContainerDied","Data":"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"}
Jul 17 22:38:59.965013 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.964921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj" event={"ID":"dc61da0e-e7f8-4b1d-8efd-d44f7370929c","Type":"ContainerDied","Data":"1dbf2eb4d3084e60153e3331489443ff39501bb29c131803e98d5ae3135ec16c"}
Jul 17 22:38:59.965013 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.964944    2570 scope.go:117] "RemoveContainer" containerID="fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"
Jul 17 22:38:59.966319 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.966299    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"
Jul 17 22:38:59.966437 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.966298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6" event={"ID":"76d03c40-54dd-43e9-a54a-130cc980b293","Type":"ContainerDied","Data":"b185c8e0c63974dac64bd8354e40af489f989ed69d15851b0b10cce2a874713c"}
Jul 17 22:38:59.977353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.977330    2570 scope.go:117] "RemoveContainer" containerID="fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"
Jul 17 22:38:59.977751 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:38:59.977723    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7\": container with ID starting with fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7 not found: ID does not exist" containerID="fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"
Jul 17 22:38:59.977863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.977755    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7"} err="failed to get container status \"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7\": rpc error: code = NotFound desc = could not find container \"fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7\": container with ID starting with fa132a159e6b28e7e8fec6620c02988c4f6b02c4917dc7cf168e6b9e091e57c7 not found: ID does not exist"
Jul 17 22:38:59.977863 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.977771    2570 scope.go:117] "RemoveContainer" containerID="7e37abc8f86a5e76012babd7e53b6a73349ed337dbc84e35b1605b3e5642556e"
Jul 17 22:38:59.996191 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:38:59.996165    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:39:00.000209 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.000186    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/auth-test-model-a56653-kserve-5d6cb7d995-qzhs6"]
Jul 17 22:39:00.008355 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.008331    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76d03c40-54dd-43e9-a54a-130cc980b293" path="/var/lib/kubelet/pods/76d03c40-54dd-43e9-a54a-130cc980b293/volumes"
Jul 17 22:39:00.065407 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065373    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065564 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065436    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d495j\" (UniqueName: \"kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065564 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065474    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065564 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065511    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065564 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065560    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065806 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home\") pod \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\" (UID: \"dc61da0e-e7f8-4b1d-8efd-d44f7370929c\") "
Jul 17 22:39:00.065806 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065733    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache" (OuterVolumeSpecName: "model-cache") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:39:00.065937 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065907    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:39:00.065989 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.065939    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home" (OuterVolumeSpecName: "home") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:39:00.066034 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.066005    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.067959 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.067931    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:39:00.068246 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.068221    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j" (OuterVolumeSpecName: "kube-api-access-d495j") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "kube-api-access-d495j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:39:00.068349 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.068230    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm" (OuterVolumeSpecName: "dshm") pod "dc61da0e-e7f8-4b1d-8efd-d44f7370929c" (UID: "dc61da0e-e7f8-4b1d-8efd-d44f7370929c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:39:00.167730 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.167447    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d495j\" (UniqueName: \"kubernetes.io/projected/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-kube-api-access-d495j\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.167730 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.167480    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.167730 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.167496    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.167730 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.167507    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.167730 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.167518    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc61da0e-e7f8-4b1d-8efd-d44f7370929c-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:39:00.288066 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.288037    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:39:00.292495 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:00.292469    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/auth-test-model-fb05ec-kserve-6bd5794c7f-974lj"]
Jul 17 22:39:02.008430 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:02.008396    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" path="/var/lib/kubelet/pods/dc61da0e-e7f8-4b1d-8efd-d44f7370929c/volumes"
Jul 17 22:39:02.148921 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:02.148882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:39:02.149126 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:02.148933    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:39:02.161529 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:02.161495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:39:02.997410 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:02.997377    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:39:34.026754 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.026720    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027044    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76d03c40-54dd-43e9-a54a-130cc980b293" containerName="main"
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027055    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="76d03c40-54dd-43e9-a54a-130cc980b293" containerName="main"
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027078    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" containerName="main"
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027083    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" containerName="main"
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027138    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc61da0e-e7f8-4b1d-8efd-d44f7370929c" containerName="main"
Jul 17 22:39:34.027151 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.027150    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="76d03c40-54dd-43e9-a54a-130cc980b293" containerName="main"
Jul 17 22:39:34.032254 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.032234    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.034525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.034500    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"kube-root-ca.crt\""
Jul 17 22:39:34.034693 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.034544    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"openshift-service-ca.crt\""
Jul 17 22:39:34.035455 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.035432    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"sub-test-model-fb05ec-kserve-self-signed-certs\""
Jul 17 22:39:34.035560 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.035435    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"default-dockercfg-8cnmk\""
Jul 17 22:39:34.041379 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.041347    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:39:34.168599 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.168811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168688    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.168811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwlcn\" (UniqueName: \"kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.168811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.168811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.168955 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.168815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269348 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwlcn\" (UniqueName: \"kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269525 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.269927 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269901    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.270006 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269907    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.270006 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.269988    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.271796 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.271772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.271910 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.271867    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.278946 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.278874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwlcn\" (UniqueName: \"kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn\") pod \"sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") " pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.342208 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.342162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:34.480180 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:34.480156    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:39:34.482146 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:39:34.482123    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56d5efae_4ecd_4382_8d0a_887322a08d57.slice/crio-f6235c594cb54090b9560811debd6b6efdc120228cff7e96ad02a8aadac796ce WatchSource:0}: Error finding container f6235c594cb54090b9560811debd6b6efdc120228cff7e96ad02a8aadac796ce: Status 404 returned error can't find the container with id f6235c594cb54090b9560811debd6b6efdc120228cff7e96ad02a8aadac796ce
Jul 17 22:39:35.153899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:35.153860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" event={"ID":"56d5efae-4ecd-4382-8d0a-887322a08d57","Type":"ContainerStarted","Data":"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"}
Jul 17 22:39:35.153899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:35.153902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" event={"ID":"56d5efae-4ecd-4382-8d0a-887322a08d57","Type":"ContainerStarted","Data":"f6235c594cb54090b9560811debd6b6efdc120228cff7e96ad02a8aadac796ce"}
Jul 17 22:39:35.176499 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:35.176444    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" podStartSLOduration=1.176427673 podStartE2EDuration="1.176427673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:39:35.175167135 +0000 UTC m=+3243.654119692" watchObservedRunningTime="2026-07-17 22:39:35.176427673 +0000 UTC m=+3243.655380228"
Jul 17 22:39:44.343096 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:44.343054    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:44.343665 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:44.343115    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:44.355868 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:44.355841    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:39:45.217659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:39:45.217631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:40:10.952387 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:10.952350    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:40:11.870865 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:11.870834    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:40:25.238186 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.238152    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:40:25.240956 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.240940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.243456 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.243432    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56653\"/\"rate-test-model-a56653-kserve-self-signed-certs\""
Jul 17 22:40:25.251203 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.251182    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:40:25.326262 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.326464 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vfs\" (UniqueName: \"kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.326464 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.326464 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.326464 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.326602 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.326478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427063 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vfs\" (UniqueName: \"kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427273 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427273 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427389 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427389 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427389 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427721 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427884 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.427884 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.427738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.429474 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.429453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.429820 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.429803    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.435716 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.435696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vfs\" (UniqueName: \"kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs\") pod \"rate-test-model-a56653-kserve-df5854955-ctv2t\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") " pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.550521 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.550491    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:25.689757 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.689731    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:40:25.691250 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:40:25.691224    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e145088_7b37_41e5_8d61_f3b7f949690c.slice/crio-4375a422c340d82a6fdca4d5dca79c45994c6c3ceeeeb67989f6374626dff2de WatchSource:0}: Error finding container 4375a422c340d82a6fdca4d5dca79c45994c6c3ceeeeb67989f6374626dff2de: Status 404 returned error can't find the container with id 4375a422c340d82a6fdca4d5dca79c45994c6c3ceeeeb67989f6374626dff2de
Jul 17 22:40:25.973303 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:25.973186    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" podUID="b1f184e2-6f13-4d36-b052-f6dd46daed26" containerName="main" containerID="cri-o://3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da" gracePeriod=45
Jul 17 22:40:26.217960 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.217933    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:40:26.334102 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334156    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334202    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334427    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljw9l\" (UniqueName: \"kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334431    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home" (OuterVolumeSpecName: "home") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:26.334493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334464    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache\") pod \"b1f184e2-6f13-4d36-b052-f6dd46daed26\" (UID: \"b1f184e2-6f13-4d36-b052-f6dd46daed26\") "
Jul 17 22:40:26.334858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334651    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:26.334858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334731    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:26.334960 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334855    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.334960 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334874    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.334960 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.334889    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.336505 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.336484    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l" (OuterVolumeSpecName: "kube-api-access-ljw9l") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "kube-api-access-ljw9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:40:26.336858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.336838    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:40:26.336858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.336847    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm" (OuterVolumeSpecName: "dshm") pod "b1f184e2-6f13-4d36-b052-f6dd46daed26" (UID: "b1f184e2-6f13-4d36-b052-f6dd46daed26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:26.421219 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.421178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" event={"ID":"3e145088-7b37-41e5-8d61-f3b7f949690c","Type":"ContainerStarted","Data":"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"}
Jul 17 22:40:26.421409 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.421229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" event={"ID":"3e145088-7b37-41e5-8d61-f3b7f949690c","Type":"ContainerStarted","Data":"4375a422c340d82a6fdca4d5dca79c45994c6c3ceeeeb67989f6374626dff2de"}
Jul 17 22:40:26.422404 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.422381    2570 generic.go:356] "Generic (PLEG): container finished" podID="b1f184e2-6f13-4d36-b052-f6dd46daed26" containerID="3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da" exitCode=0
Jul 17 22:40:26.422491 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.422418    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"
Jul 17 22:40:26.422491 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.422465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" event={"ID":"b1f184e2-6f13-4d36-b052-f6dd46daed26","Type":"ContainerDied","Data":"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"}
Jul 17 22:40:26.422579 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.422503    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k" event={"ID":"b1f184e2-6f13-4d36-b052-f6dd46daed26","Type":"ContainerDied","Data":"815b7a02261c3109462f686f06605fa445a67f49fe989b48c155c9a99adb9567"}
Jul 17 22:40:26.422579 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.422522    2570 scope.go:117] "RemoveContainer" containerID="3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"
Jul 17 22:40:26.432434 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.432415    2570 scope.go:117] "RemoveContainer" containerID="3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"
Jul 17 22:40:26.432741 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:40:26.432722    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da\": container with ID starting with 3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da not found: ID does not exist" containerID="3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"
Jul 17 22:40:26.432792 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.432750    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da"} err="failed to get container status \"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da\": rpc error: code = NotFound desc = could not find container \"3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da\": container with ID starting with 3193a4fed229320a9715ec11dd4d1f16be045a57e93a7763dc8540bd38e850da not found: ID does not exist"
Jul 17 22:40:26.436179 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.436158    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljw9l\" (UniqueName: \"kubernetes.io/projected/b1f184e2-6f13-4d36-b052-f6dd46daed26-kube-api-access-ljw9l\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.436262 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.436183    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f184e2-6f13-4d36-b052-f6dd46daed26-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.436262 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.436196    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f184e2-6f13-4d36-b052-f6dd46daed26-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:26.442707 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.442654    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" podStartSLOduration=1.442638313 podStartE2EDuration="1.442638313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:40:26.439801579 +0000 UTC m=+3294.918754164" watchObservedRunningTime="2026-07-17 22:40:26.442638313 +0000 UTC m=+3294.921590860"
Jul 17 22:40:26.457982 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.457954    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:40:26.461837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.461813    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/sub-test-model-a56653-kserve-6448bcf87f-hxk5k"]
Jul 17 22:40:26.890909 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:26.890866    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" podUID="56d5efae-4ecd-4382-8d0a-887322a08d57" containerName="main" containerID="cri-o://e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed" gracePeriod=45
Jul 17 22:40:27.151364 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.151301    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:40:27.242847 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.242817    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243018 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.242860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243018 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.242902    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243018 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.242919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243018 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.242952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwlcn\" (UniqueName: \"kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243190 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm\") pod \"56d5efae-4ecd-4382-8d0a-887322a08d57\" (UID: \"56d5efae-4ecd-4382-8d0a-887322a08d57\") "
Jul 17 22:40:27.243190 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243063    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache" (OuterVolumeSpecName: "model-cache") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:27.243190 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243169    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home" (OuterVolumeSpecName: "home") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:27.243353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243209    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:27.243353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243272    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.243353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243288    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.243353 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.243299    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.245152 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.245125    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm" (OuterVolumeSpecName: "dshm") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:40:27.245259 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.245159    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:40:27.245259 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.245193    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn" (OuterVolumeSpecName: "kube-api-access-bwlcn") pod "56d5efae-4ecd-4382-8d0a-887322a08d57" (UID: "56d5efae-4ecd-4382-8d0a-887322a08d57"). InnerVolumeSpecName "kube-api-access-bwlcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:40:27.344416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.344383    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwlcn\" (UniqueName: \"kubernetes.io/projected/56d5efae-4ecd-4382-8d0a-887322a08d57-kube-api-access-bwlcn\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.344416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.344413    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5efae-4ecd-4382-8d0a-887322a08d57-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.344416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.344424    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5efae-4ecd-4382-8d0a-887322a08d57-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:40:27.428946 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.428866    2570 generic.go:356] "Generic (PLEG): container finished" podID="56d5efae-4ecd-4382-8d0a-887322a08d57" containerID="e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed" exitCode=0
Jul 17 22:40:27.428946 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.428911    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"
Jul 17 22:40:27.429154 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.428959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" event={"ID":"56d5efae-4ecd-4382-8d0a-887322a08d57","Type":"ContainerDied","Data":"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"}
Jul 17 22:40:27.429154 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.429004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv" event={"ID":"56d5efae-4ecd-4382-8d0a-887322a08d57","Type":"ContainerDied","Data":"f6235c594cb54090b9560811debd6b6efdc120228cff7e96ad02a8aadac796ce"}
Jul 17 22:40:27.429154 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.429028    2570 scope.go:117] "RemoveContainer" containerID="e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"
Jul 17 22:40:27.440811 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.440792    2570 scope.go:117] "RemoveContainer" containerID="e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"
Jul 17 22:40:27.441083 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:40:27.441064    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed\": container with ID starting with e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed not found: ID does not exist" containerID="e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"
Jul 17 22:40:27.441131 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.441092    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed"} err="failed to get container status \"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed\": rpc error: code = NotFound desc = could not find container \"e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed\": container with ID starting with e9c0321fd0fc5304c08d36ad4f57335639d29ca658cd15cf09e0efb9c60b17ed not found: ID does not exist"
Jul 17 22:40:27.454737 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.454711    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:40:27.462595 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:27.457160    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/sub-test-model-fb05ec-kserve-78c6db94c7-9rhhv"]
Jul 17 22:40:28.008344 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:28.008315    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d5efae-4ecd-4382-8d0a-887322a08d57" path="/var/lib/kubelet/pods/56d5efae-4ecd-4382-8d0a-887322a08d57/volumes"
Jul 17 22:40:28.008725 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:28.008711    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f184e2-6f13-4d36-b052-f6dd46daed26" path="/var/lib/kubelet/pods/b1f184e2-6f13-4d36-b052-f6dd46daed26/volumes"
Jul 17 22:40:32.279562 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:32.279521    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:40:32.286269 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:32.286247    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:40:35.551095 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:35.551058    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:35.551493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:35.551111    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:35.563991 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:35.563964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:40:36.490858 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:40:36.490829    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:41:06.227374 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227295    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227727    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5efae-4ecd-4382-8d0a-887322a08d57" containerName="main"
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227741    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5efae-4ecd-4382-8d0a-887322a08d57" containerName="main"
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227759    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f184e2-6f13-4d36-b052-f6dd46daed26" containerName="main"
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227764    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f184e2-6f13-4d36-b052-f6dd46daed26" containerName="main"
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227824    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5efae-4ecd-4382-8d0a-887322a08d57" containerName="main"
Jul 17 22:41:06.227837 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.227834    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f184e2-6f13-4d36-b052-f6dd46daed26" containerName="main"
Jul 17 22:41:06.230950 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.230934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.233843 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.233818    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"openshift-service-ca.crt\""
Jul 17 22:41:06.234713 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.234692    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"rate-test-model-fb05ec-kserve-self-signed-certs\""
Jul 17 22:41:06.234787 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.234758    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"default-dockercfg-8cnmk\""
Jul 17 22:41:06.234787 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.234779    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fb05ec\"/\"kube-root-ca.crt\""
Jul 17 22:41:06.246177 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.246138    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:41:06.276638 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.276812 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdh42\" (UniqueName: \"kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.276812 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.276812 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.276812 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.276989 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.276866    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377463 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377463 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377750 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdh42\" (UniqueName: \"kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377750 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377750 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377750 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.377989 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.377966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.378057 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.378038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.378115 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.378067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.379949 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.379923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.380057 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.380024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.386685 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.386657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdh42\" (UniqueName: \"kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42\") pod \"rate-test-model-fb05ec-kserve-6cc4845ff-llkcz\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") " pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.540575 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.540545    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:06.680983 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:06.680958    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:41:07.639350 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:07.639310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" event={"ID":"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d","Type":"ContainerStarted","Data":"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"}
Jul 17 22:41:07.639350 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:07.639355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" event={"ID":"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d","Type":"ContainerStarted","Data":"eca39502652ea854ab01c0cc0b8453ea1a73f91e6bb19d657df57a20531ef862"}
Jul 17 22:41:07.659275 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:07.659222    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" podStartSLOduration=1.659205784 podStartE2EDuration="1.659205784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:41:07.657656468 +0000 UTC m=+3336.136609261" watchObservedRunningTime="2026-07-17 22:41:07.659205784 +0000 UTC m=+3336.138158339"
Jul 17 22:41:16.541045 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:16.540998    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:16.541462 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:16.541060    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:16.553909 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:16.553874    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:16.700759 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:16.700726    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:41:56.704129 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:56.704094    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:41:57.656184 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:41:57.656152    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:42:11.724659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.724578    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" podUID="3e145088-7b37-41e5-8d61-f3b7f949690c" containerName="main" containerID="cri-o://6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9" gracePeriod=45
Jul 17 22:42:11.969369 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.969341    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:42:11.980341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.980270    2570 generic.go:356] "Generic (PLEG): container finished" podID="3e145088-7b37-41e5-8d61-f3b7f949690c" containerID="6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9" exitCode=0
Jul 17 22:42:11.980341 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.980328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" event={"ID":"3e145088-7b37-41e5-8d61-f3b7f949690c","Type":"ContainerDied","Data":"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"}
Jul 17 22:42:11.980511 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.980346    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"
Jul 17 22:42:11.980511 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.980355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t" event={"ID":"3e145088-7b37-41e5-8d61-f3b7f949690c","Type":"ContainerDied","Data":"4375a422c340d82a6fdca4d5dca79c45994c6c3ceeeeb67989f6374626dff2de"}
Jul 17 22:42:11.980511 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.980378    2570 scope.go:117] "RemoveContainer" containerID="6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"
Jul 17 22:42:11.993055 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.992942    2570 scope.go:117] "RemoveContainer" containerID="6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"
Jul 17 22:42:11.993559 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:11.993492    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9\": container with ID starting with 6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9 not found: ID does not exist" containerID="6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"
Jul 17 22:42:11.993559 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:11.993530    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9"} err="failed to get container status \"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9\": rpc error: code = NotFound desc = could not find container \"6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9\": container with ID starting with 6ef9ce039294845726eb55abcc0a4af91e86e9d306d297b3b9dda5ceb334b7b9 not found: ID does not exist"
Jul 17 22:42:12.074947 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.074911    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.074967    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.074984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075010    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075048    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5vfs\" (UniqueName: \"kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075141 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir\") pod \"3e145088-7b37-41e5-8d61-f3b7f949690c\" (UID: \"3e145088-7b37-41e5-8d61-f3b7f949690c\") "
Jul 17 22:42:12.075405 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075249    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home" (OuterVolumeSpecName: "home") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:12.075405 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075269    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:12.075405 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075363    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.075405 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075383    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.075597 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.075433    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:12.077214 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.077189    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm" (OuterVolumeSpecName: "dshm") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:12.077322 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.077305    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:42:12.077376 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.077357    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs" (OuterVolumeSpecName: "kube-api-access-c5vfs") pod "3e145088-7b37-41e5-8d61-f3b7f949690c" (UID: "3e145088-7b37-41e5-8d61-f3b7f949690c"). InnerVolumeSpecName "kube-api-access-c5vfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:42:12.176093 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.176041    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.176093 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.176088    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e145088-7b37-41e5-8d61-f3b7f949690c-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.176093 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.176100    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5vfs\" (UniqueName: \"kubernetes.io/projected/3e145088-7b37-41e5-8d61-f3b7f949690c-kube-api-access-c5vfs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.176093 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.176112    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e145088-7b37-41e5-8d61-f3b7f949690c-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:12.304575 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.304533    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:42:12.308654 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.308608    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56653/rate-test-model-a56653-kserve-df5854955-ctv2t"]
Jul 17 22:42:12.676592 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.676487    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" podUID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" containerName="main" containerID="cri-o://b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea" gracePeriod=45
Jul 17 22:42:12.930379 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.930311    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:42:12.986935 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.986902    2570 generic.go:356] "Generic (PLEG): container finished" podID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" containerID="b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea" exitCode=0
Jul 17 22:42:12.987089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.986950    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"
Jul 17 22:42:12.987089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.986986    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" event={"ID":"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d","Type":"ContainerDied","Data":"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"}
Jul 17 22:42:12.987089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.987025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz" event={"ID":"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d","Type":"ContainerDied","Data":"eca39502652ea854ab01c0cc0b8453ea1a73f91e6bb19d657df57a20531ef862"}
Jul 17 22:42:12.987089 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.987044    2570 scope.go:117] "RemoveContainer" containerID="b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"
Jul 17 22:42:12.995802 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.995781    2570 scope.go:117] "RemoveContainer" containerID="b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"
Jul 17 22:42:12.996081 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:12.996059    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea\": container with ID starting with b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea not found: ID does not exist" containerID="b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"
Jul 17 22:42:12.996129 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:12.996091    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea"} err="failed to get container status \"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea\": rpc error: code = NotFound desc = could not find container \"b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea\": container with ID starting with b39828f4deec0133c9d0703781ba25ed645a2fb345d5fee4b6d8aad57e543dea not found: ID does not exist"
Jul 17 22:42:13.083753 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083712    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.083753 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083760    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.083993 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.083993 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.083993 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083866    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdh42\" (UniqueName: \"kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.083993 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.083900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm\") pod \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\" (UID: \"6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d\") "
Jul 17 22:42:13.084200 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084044    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home" (OuterVolumeSpecName: "home") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:13.084200 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084091    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:13.084200 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084113    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:13.084365 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084233    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-home\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.084365 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084252    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tmp-dir\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.084365 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.084265    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-model-cache\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.086234 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.086203    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42" (OuterVolumeSpecName: "kube-api-access-pdh42") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "kube-api-access-pdh42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:42:13.086234 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.086214    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm" (OuterVolumeSpecName: "dshm") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 22:42:13.086426 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.086308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" (UID: "6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:42:13.185670 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.185547    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-tls-certs\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.185670 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.185578    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdh42\" (UniqueName: \"kubernetes.io/projected/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-kube-api-access-pdh42\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.185670 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.185592    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d-dshm\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:13.310535 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.310493    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:42:13.314711 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:13.314687    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fb05ec/rate-test-model-fb05ec-kserve-6cc4845ff-llkcz"]
Jul 17 22:42:14.008572 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:14.008537    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e145088-7b37-41e5-8d61-f3b7f949690c" path="/var/lib/kubelet/pods/3e145088-7b37-41e5-8d61-f3b7f949690c/volumes"
Jul 17 22:42:14.008990 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:14.008976    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" path="/var/lib/kubelet/pods/6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d/volumes"
Jul 17 22:42:16.812240 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812203    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"]
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812530    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e145088-7b37-41e5-8d61-f3b7f949690c" containerName="main"
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812542    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e145088-7b37-41e5-8d61-f3b7f949690c" containerName="main"
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812569    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" containerName="main"
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812574    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" containerName="main"
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812645    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e145088-7b37-41e5-8d61-f3b7f949690c" containerName="main"
Jul 17 22:42:16.812659 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.812653    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1c8f59-8a05-4ecf-ac6f-d4e85e85df0d" containerName="main"
Jul 17 22:42:16.815772 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.815756    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:16.818137 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.818117    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:42:16.824381 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.824351    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"]
Jul 17 22:42:16.922565 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:16.922519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a56653-pb78l\" (UID: \"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:17.023921 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:17.023886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a56653-pb78l\" (UID: \"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:17.024557 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:17.024535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a56653-pb78l\" (UID: \"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:17.126706 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:17.126594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:17.264182 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:17.264154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"]
Jul 17 22:42:17.266184 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:42:17.266152    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c6b2c_99bb_4cdc_a05a_1148f1dda3f7.slice/crio-0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1 WatchSource:0}: Error finding container 0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1: Status 404 returned error can't find the container with id 0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1
Jul 17 22:42:18.014915 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:18.014882    2570 generic.go:356] "Generic (PLEG): container finished" podID="039c6b2c-99bb-4cdc-a05a-1148f1dda3f7" containerID="920de0c5d256755a2116191113299a1c5cf3c079fb83cd6a6e031d0afa0c6d7b" exitCode=0
Jul 17 22:42:18.015299 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:18.014976    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l" event={"ID":"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7","Type":"ContainerDied","Data":"920de0c5d256755a2116191113299a1c5cf3c079fb83cd6a6e031d0afa0c6d7b"}
Jul 17 22:42:18.015299 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:18.015029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l" event={"ID":"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7","Type":"ContainerStarted","Data":"0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1"}
Jul 17 22:42:19.157583 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:19.157554    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:19.242477 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:19.242438    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca\") pod \"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7\" (UID: \"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7\") "
Jul 17 22:42:19.242815 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:19.242792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "039c6b2c-99bb-4cdc-a05a-1148f1dda3f7" (UID: "039c6b2c-99bb-4cdc-a05a-1148f1dda3f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:19.343995 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:19.343968    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/039c6b2c-99bb-4cdc-a05a-1148f1dda3f7-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:20.025686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:20.025647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l" event={"ID":"039c6b2c-99bb-4cdc-a05a-1148f1dda3f7","Type":"ContainerDied","Data":"0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1"}
Jul 17 22:42:20.025686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:20.025671    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a56653-pb78l"
Jul 17 22:42:20.025889 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:20.025709    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0463dc1b49745b71af8f4407e5399cebf0a3a9be0dd37440a707fba163502ed1"
Jul 17 22:42:23.440739 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.440653    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:23.441327 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.441139    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039c6b2c-99bb-4cdc-a05a-1148f1dda3f7" containerName="revoke-keys"
Jul 17 22:42:23.441327 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.441157    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="039c6b2c-99bb-4cdc-a05a-1148f1dda3f7" containerName="revoke-keys"
Jul 17 22:42:23.441327 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.441253    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="039c6b2c-99bb-4cdc-a05a-1148f1dda3f7" containerName="revoke-keys"
Jul 17 22:42:23.444272 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.444252    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:23.447416 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.447396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5k9rd\""
Jul 17 22:42:23.451312 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.451291    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:23.580989 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.580952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-t254h\" (UID: \"8690676e-c66f-4ba3-9bb7-291cde9ff653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:23.681865 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.681828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-t254h\" (UID: \"8690676e-c66f-4ba3-9bb7-291cde9ff653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:23.682446 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.682425    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ded85f30-t254h\" (UID: \"8690676e-c66f-4ba3-9bb7-291cde9ff653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:23.755927 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.755849    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:23.893166 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:23.893129    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:23.894346 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:42:23.894322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8690676e_c66f_4ba3_9bb7_291cde9ff653.slice/crio-a094d84811e76679a36819aeadcecaf5d51b9acddfd31c288dc91d55bca5f471 WatchSource:0}: Error finding container a094d84811e76679a36819aeadcecaf5d51b9acddfd31c288dc91d55bca5f471: Status 404 returned error can't find the container with id a094d84811e76679a36819aeadcecaf5d51b9acddfd31c288dc91d55bca5f471
Jul 17 22:42:24.048799 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:24.048713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" event={"ID":"8690676e-c66f-4ba3-9bb7-291cde9ff653","Type":"ContainerStarted","Data":"a094d84811e76679a36819aeadcecaf5d51b9acddfd31c288dc91d55bca5f471"}
Jul 17 22:42:25.055836 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:25.055804    2570 generic.go:356] "Generic (PLEG): container finished" podID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerID="ca095933904ba89fb2f9342b82a586064795eaa2e9983dd32eafe50f15869002" exitCode=6
Jul 17 22:42:25.056264 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:25.055893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" event={"ID":"8690676e-c66f-4ba3-9bb7-291cde9ff653","Type":"ContainerDied","Data":"ca095933904ba89fb2f9342b82a586064795eaa2e9983dd32eafe50f15869002"}
Jul 17 22:42:25.056264 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:25.056027    2570 scope.go:117] "RemoveContainer" containerID="ca095933904ba89fb2f9342b82a586064795eaa2e9983dd32eafe50f15869002"
Jul 17 22:42:26.062697 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:26.062662    2570 generic.go:356] "Generic (PLEG): container finished" podID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerID="20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d" exitCode=6
Jul 17 22:42:26.063118 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:26.062726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" event={"ID":"8690676e-c66f-4ba3-9bb7-291cde9ff653","Type":"ContainerDied","Data":"20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d"}
Jul 17 22:42:26.063118 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:26.062785    2570 scope.go:117] "RemoveContainer" containerID="ca095933904ba89fb2f9342b82a586064795eaa2e9983dd32eafe50f15869002"
Jul 17 22:42:26.063118 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:26.062964    2570 scope.go:117] "RemoveContainer" containerID="20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d"
Jul 17 22:42:26.063254 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:26.063201    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-t254h_odh-ai-gateway-infra(8690676e-c66f-4ba3-9bb7-291cde9ff653)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653"
Jul 17 22:42:27.069030 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.068995    2570 scope.go:117] "RemoveContainer" containerID="20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d"
Jul 17 22:42:27.069415 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:27.069223    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-t254h_odh-ai-gateway-infra(8690676e-c66f-4ba3-9bb7-291cde9ff653)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653"
Jul 17 22:42:27.336338 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.336252    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:42:27.336559 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.336533    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" podUID="2e1ea72d-c376-4f4c-8360-236aae90a518" containerName="maas-api" containerID="cri-o://d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469" gracePeriod=30
Jul 17 22:42:27.584794 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.584766    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:42:27.715973 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.715889    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxj5r\" (UniqueName: \"kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r\") pod \"2e1ea72d-c376-4f4c-8360-236aae90a518\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") "
Jul 17 22:42:27.716124 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.715986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") pod \"2e1ea72d-c376-4f4c-8360-236aae90a518\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") "
Jul 17 22:42:27.716124 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.716019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca\") pod \"2e1ea72d-c376-4f4c-8360-236aae90a518\" (UID: \"2e1ea72d-c376-4f4c-8360-236aae90a518\") "
Jul 17 22:42:27.716422 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.716390    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e1ea72d-c376-4f4c-8360-236aae90a518" (UID: "2e1ea72d-c376-4f4c-8360-236aae90a518"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:27.718098 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.718063    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r" (OuterVolumeSpecName: "kube-api-access-nxj5r") pod "2e1ea72d-c376-4f4c-8360-236aae90a518" (UID: "2e1ea72d-c376-4f4c-8360-236aae90a518"). InnerVolumeSpecName "kube-api-access-nxj5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:42:27.718207 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.718161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e1ea72d-c376-4f4c-8360-236aae90a518" (UID: "2e1ea72d-c376-4f4c-8360-236aae90a518"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:42:27.816910 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.816863    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1ea72d-c376-4f4c-8360-236aae90a518-maas-api-tls\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:27.816910 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.816903    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1ea72d-c376-4f4c-8360-236aae90a518-openshift-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:27.816910 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:27.816918    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxj5r\" (UniqueName: \"kubernetes.io/projected/2e1ea72d-c376-4f4c-8360-236aae90a518-kube-api-access-nxj5r\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:28.075218 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.075186    2570 generic.go:356] "Generic (PLEG): container finished" podID="2e1ea72d-c376-4f4c-8360-236aae90a518" containerID="d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469" exitCode=0
Jul 17 22:42:28.075733 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.075232    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"
Jul 17 22:42:28.075733 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.075250    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" event={"ID":"2e1ea72d-c376-4f4c-8360-236aae90a518","Type":"ContainerDied","Data":"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"}
Jul 17 22:42:28.075733 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.075302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh" event={"ID":"2e1ea72d-c376-4f4c-8360-236aae90a518","Type":"ContainerDied","Data":"98968957ef2367eb96734ebf634259772994c0a41a17293216c84986b6bf82ff"}
Jul 17 22:42:28.075733 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.075333    2570 scope.go:117] "RemoveContainer" containerID="d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"
Jul 17 22:42:28.084475 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.084457    2570 scope.go:117] "RemoveContainer" containerID="d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"
Jul 17 22:42:28.084806 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:28.084784    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469\": container with ID starting with d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469 not found: ID does not exist" containerID="d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"
Jul 17 22:42:28.084867 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.084817    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469"} err="failed to get container status \"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469\": rpc error: code = NotFound desc = could not find container \"d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469\": container with ID starting with d5d37a0c027bb671cea29f19ac24b03468d1b7c63d2ddf0e827ea5f440097469 not found: ID does not exist"
Jul 17 22:42:28.093546 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.093521    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:42:28.100898 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.100872    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a56653-6cf84cb8db-6v7nh"]
Jul 17 22:42:28.828608 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.828570    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:28.828921 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.828909    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1ea72d-c376-4f4c-8360-236aae90a518" containerName="maas-api"
Jul 17 22:42:28.828965 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.828922    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1ea72d-c376-4f4c-8360-236aae90a518" containerName="maas-api"
Jul 17 22:42:28.829000 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.828991    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1ea72d-c376-4f4c-8360-236aae90a518" containerName="maas-api"
Jul 17 22:42:28.833288 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.833268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:28.841407 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.841381    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:28.926685 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:28.926644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr\" (UID: \"a567e542-f062-42e9-8b64-94dbae5f368f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:29.027458 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:29.027422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr\" (UID: \"a567e542-f062-42e9-8b64-94dbae5f368f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:29.028086 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:29.028067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr\" (UID: \"a567e542-f062-42e9-8b64-94dbae5f368f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:29.144367 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:29.144273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:29.289732 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:29.289707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:29.291728 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:42:29.291686    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda567e542_f062_42e9_8b64_94dbae5f368f.slice/crio-182fea0ef0e21010f3c737221cf26eed8d5d423dcb0d7e8e8d79599b315bc559 WatchSource:0}: Error finding container 182fea0ef0e21010f3c737221cf26eed8d5d423dcb0d7e8e8d79599b315bc559: Status 404 returned error can't find the container with id 182fea0ef0e21010f3c737221cf26eed8d5d423dcb0d7e8e8d79599b315bc559
Jul 17 22:42:30.009134 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:30.009103    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1ea72d-c376-4f4c-8360-236aae90a518" path="/var/lib/kubelet/pods/2e1ea72d-c376-4f4c-8360-236aae90a518/volumes"
Jul 17 22:42:30.088334 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:30.088300    2570 generic.go:356] "Generic (PLEG): container finished" podID="a567e542-f062-42e9-8b64-94dbae5f368f" containerID="66bfe4abe1d0e18bc714a2b131088aa931d886e5937bb3f20a8bd04d75bb6ec1" exitCode=6
Jul 17 22:42:30.088553 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:30.088385    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" event={"ID":"a567e542-f062-42e9-8b64-94dbae5f368f","Type":"ContainerDied","Data":"66bfe4abe1d0e18bc714a2b131088aa931d886e5937bb3f20a8bd04d75bb6ec1"}
Jul 17 22:42:30.088553 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:30.088436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" event={"ID":"a567e542-f062-42e9-8b64-94dbae5f368f","Type":"ContainerStarted","Data":"182fea0ef0e21010f3c737221cf26eed8d5d423dcb0d7e8e8d79599b315bc559"}
Jul 17 22:42:30.088705 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:30.088630    2570 scope.go:117] "RemoveContainer" containerID="66bfe4abe1d0e18bc714a2b131088aa931d886e5937bb3f20a8bd04d75bb6ec1"
Jul 17 22:42:31.095264 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:31.095226    2570 generic.go:356] "Generic (PLEG): container finished" podID="a567e542-f062-42e9-8b64-94dbae5f368f" containerID="4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b" exitCode=6
Jul 17 22:42:31.095686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:31.095302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" event={"ID":"a567e542-f062-42e9-8b64-94dbae5f368f","Type":"ContainerDied","Data":"4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b"}
Jul 17 22:42:31.095686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:31.095396    2570 scope.go:117] "RemoveContainer" containerID="66bfe4abe1d0e18bc714a2b131088aa931d886e5937bb3f20a8bd04d75bb6ec1"
Jul 17 22:42:31.095686 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:31.095578    2570 scope.go:117] "RemoveContainer" containerID="4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b"
Jul 17 22:42:31.095864 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:31.095814    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr_odh-ai-gateway-infra(a567e542-f062-42e9-8b64-94dbae5f368f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" podUID="a567e542-f062-42e9-8b64-94dbae5f368f"
Jul 17 22:42:32.101580 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:32.101551    2570 scope.go:117] "RemoveContainer" containerID="4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b"
Jul 17 22:42:32.101976 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:32.101777    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr_odh-ai-gateway-infra(a567e542-f062-42e9-8b64-94dbae5f368f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" podUID="a567e542-f062-42e9-8b64-94dbae5f368f"
Jul 17 22:42:40.003165 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:40.003136    2570 scope.go:117] "RemoveContainer" containerID="20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d"
Jul 17 22:42:41.155999 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:41.155960    2570 generic.go:356] "Generic (PLEG): container finished" podID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerID="57dbb2e866d7c8e921bed327081d197dbe2354474630edc19eadf6f3a96793fc" exitCode=6
Jul 17 22:42:41.156393 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:41.156052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" event={"ID":"8690676e-c66f-4ba3-9bb7-291cde9ff653","Type":"ContainerDied","Data":"57dbb2e866d7c8e921bed327081d197dbe2354474630edc19eadf6f3a96793fc"}
Jul 17 22:42:41.156393 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:41.156131    2570 scope.go:117] "RemoveContainer" containerID="20b8862aa3886d6a65dbf715246cdaf002d805378606d97d5d59ea80d1711c1d"
Jul 17 22:42:41.156545 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:41.156528    2570 scope.go:117] "RemoveContainer" containerID="57dbb2e866d7c8e921bed327081d197dbe2354474630edc19eadf6f3a96793fc"
Jul 17 22:42:41.156818 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:41.156791    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ded85f30-t254h_odh-ai-gateway-infra(8690676e-c66f-4ba3-9bb7-291cde9ff653)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653"
Jul 17 22:42:42.191280 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.187957    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:42.319572 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.319545    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:42.335275 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.335245    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca\") pod \"8690676e-c66f-4ba3-9bb7-291cde9ff653\" (UID: \"8690676e-c66f-4ba3-9bb7-291cde9ff653\") "
Jul 17 22:42:42.335605 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.335582    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8690676e-c66f-4ba3-9bb7-291cde9ff653" (UID: "8690676e-c66f-4ba3-9bb7-291cde9ff653"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:42.436246 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.436194    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8690676e-c66f-4ba3-9bb7-291cde9ff653-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:42.973427 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973396    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"]
Jul 17 22:42:42.973741 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973728    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973798 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973742    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973798 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973756    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973798 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973761    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973825    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973835    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.973890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.973840    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:42:42.976937 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.976921    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:42.988906 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:42.988880    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"]
Jul 17 22:42:43.040609 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.040570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x\" (UID: \"a5dbf7c4-04b5-41f7-848f-f0bf363ea976\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:43.141251 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.141213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x\" (UID: \"a5dbf7c4-04b5-41f7-848f-f0bf363ea976\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:43.141899 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.141879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x\" (UID: \"a5dbf7c4-04b5-41f7-848f-f0bf363ea976\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:43.168962 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.168929    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"
Jul 17 22:42:43.169106 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.168961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h" event={"ID":"8690676e-c66f-4ba3-9bb7-291cde9ff653","Type":"ContainerDied","Data":"a094d84811e76679a36819aeadcecaf5d51b9acddfd31c288dc91d55bca5f471"}
Jul 17 22:42:43.169106 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.169021    2570 scope.go:117] "RemoveContainer" containerID="57dbb2e866d7c8e921bed327081d197dbe2354474630edc19eadf6f3a96793fc"
Jul 17 22:42:43.204848 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.204816    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:43.211303 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.211271    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ded85f30-t254h"]
Jul 17 22:42:43.287069 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.287039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:43.425985 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:43.425959    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"]
Jul 17 22:42:43.427734 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:42:43.427696    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dbf7c4_04b5_41f7_848f_f0bf363ea976.slice/crio-052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632 WatchSource:0}: Error finding container 052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632: Status 404 returned error can't find the container with id 052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632
Jul 17 22:42:44.008758 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:44.008676    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" path="/var/lib/kubelet/pods/8690676e-c66f-4ba3-9bb7-291cde9ff653/volumes"
Jul 17 22:42:44.175038 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:44.175010    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x" event={"ID":"a5dbf7c4-04b5-41f7-848f-f0bf363ea976","Type":"ContainerStarted","Data":"2fdce04940a67886d70a08e75b6c61dbf052d56320cdb2b6125bd217a663b75c"}
Jul 17 22:42:44.175203 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:44.175062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x" event={"ID":"a5dbf7c4-04b5-41f7-848f-f0bf363ea976","Type":"ContainerStarted","Data":"052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632"}
Jul 17 22:42:44.197773 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:44.197724    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x" podStartSLOduration=2.19770893 podStartE2EDuration="2.19770893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:42:44.195724386 +0000 UTC m=+3432.674676933" watchObservedRunningTime="2026-07-17 22:42:44.19770893 +0000 UTC m=+3432.676661486"
Jul 17 22:42:45.182916 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:45.182885    2570 generic.go:356] "Generic (PLEG): container finished" podID="a5dbf7c4-04b5-41f7-848f-f0bf363ea976" containerID="2fdce04940a67886d70a08e75b6c61dbf052d56320cdb2b6125bd217a663b75c" exitCode=0
Jul 17 22:42:45.183326 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:45.182979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x" event={"ID":"a5dbf7c4-04b5-41f7-848f-f0bf363ea976","Type":"ContainerDied","Data":"2fdce04940a67886d70a08e75b6c61dbf052d56320cdb2b6125bd217a663b75c"}
Jul 17 22:42:46.317556 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:46.317532    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:46.366191 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:46.366163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca\") pod \"a5dbf7c4-04b5-41f7-848f-f0bf363ea976\" (UID: \"a5dbf7c4-04b5-41f7-848f-f0bf363ea976\") "
Jul 17 22:42:46.366542 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:46.366523    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5dbf7c4-04b5-41f7-848f-f0bf363ea976" (UID: "a5dbf7c4-04b5-41f7-848f-f0bf363ea976"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:46.467010 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:46.466925    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dbf7c4-04b5-41f7-848f-f0bf363ea976-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:47.003115 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:47.003083    2570 scope.go:117] "RemoveContainer" containerID="4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b"
Jul 17 22:42:47.195424 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:47.195389    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x"
Jul 17 22:42:47.195424 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:47.195409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x" event={"ID":"a5dbf7c4-04b5-41f7-848f-f0bf363ea976","Type":"ContainerDied","Data":"052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632"}
Jul 17 22:42:47.195648 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:47.195457    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="052a80397740577a1076970779611e7219c1455b25198080c82c221bd7782632"
Jul 17 22:42:48.202121 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:48.202090    2570 generic.go:356] "Generic (PLEG): container finished" podID="a567e542-f062-42e9-8b64-94dbae5f368f" containerID="7c7b2638bf91af968cbf456f50675ba74b83e2691bbce89e423b98ba5e2d297a" exitCode=6
Jul 17 22:42:48.202544 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:48.202133    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" event={"ID":"a567e542-f062-42e9-8b64-94dbae5f368f","Type":"ContainerDied","Data":"7c7b2638bf91af968cbf456f50675ba74b83e2691bbce89e423b98ba5e2d297a"}
Jul 17 22:42:48.202544 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:48.202181    2570 scope.go:117] "RemoveContainer" containerID="4f87c2fa22aac98c8996e85d4cab8ab614af1ab50f7d3a5103f98a6e0fe3573b"
Jul 17 22:42:48.202544 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:48.202466    2570 scope.go:117] "RemoveContainer" containerID="7c7b2638bf91af968cbf456f50675ba74b83e2691bbce89e423b98ba5e2d297a"
Jul 17 22:42:48.202689 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:48.202661    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr_odh-ai-gateway-infra(a567e542-f062-42e9-8b64-94dbae5f368f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" podUID="a567e542-f062-42e9-8b64-94dbae5f368f"
Jul 17 22:42:49.230325 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:49.230288    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:49.364023 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:49.363996    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:49.391299 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:49.391270    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca\") pod \"a567e542-f062-42e9-8b64-94dbae5f368f\" (UID: \"a567e542-f062-42e9-8b64-94dbae5f368f\") "
Jul 17 22:42:49.391651 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:49.391628    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a567e542-f062-42e9-8b64-94dbae5f368f" (UID: "a567e542-f062-42e9-8b64-94dbae5f368f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:49.491991 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:49.491895    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a567e542-f062-42e9-8b64-94dbae5f368f-maas-api-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:50.215304 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:50.215278    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"
Jul 17 22:42:50.215510 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:50.215281    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr" event={"ID":"a567e542-f062-42e9-8b64-94dbae5f368f","Type":"ContainerDied","Data":"182fea0ef0e21010f3c737221cf26eed8d5d423dcb0d7e8e8d79599b315bc559"}
Jul 17 22:42:50.215510 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:50.215403    2570 scope.go:117] "RemoveContainer" containerID="7c7b2638bf91af968cbf456f50675ba74b83e2691bbce89e423b98ba5e2d297a"
Jul 17 22:42:50.231840 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:50.231812    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:50.237180 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:50.237157    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7fb802f2-tqrcr"]
Jul 17 22:42:52.008661 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:52.008601    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" path="/var/lib/kubelet/pods/a567e542-f062-42e9-8b64-94dbae5f368f/volumes"
Jul 17 22:42:53.428410 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.428364    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:42:53.428922 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.428596    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" podUID="81a0b367-da2d-47ba-9782-6fc08b539096" containerName="maas-api" containerID="cri-o://707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d" gracePeriod=30
Jul 17 22:42:53.671199 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.671174    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:42:53.726870 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.726781    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca\") pod \"81a0b367-da2d-47ba-9782-6fc08b539096\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") "
Jul 17 22:42:53.726870 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.726840    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj\") pod \"81a0b367-da2d-47ba-9782-6fc08b539096\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") "
Jul 17 22:42:53.727086 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.727032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") pod \"81a0b367-da2d-47ba-9782-6fc08b539096\" (UID: \"81a0b367-da2d-47ba-9782-6fc08b539096\") "
Jul 17 22:42:53.727230 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.727202    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "81a0b367-da2d-47ba-9782-6fc08b539096" (UID: "81a0b367-da2d-47ba-9782-6fc08b539096"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 22:42:53.727300 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.727285    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81a0b367-da2d-47ba-9782-6fc08b539096-openshift-service-ca\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:53.729158 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.729118    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj" (OuterVolumeSpecName: "kube-api-access-2cdzj") pod "81a0b367-da2d-47ba-9782-6fc08b539096" (UID: "81a0b367-da2d-47ba-9782-6fc08b539096"). InnerVolumeSpecName "kube-api-access-2cdzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 22:42:53.729265 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.729179    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "81a0b367-da2d-47ba-9782-6fc08b539096" (UID: "81a0b367-da2d-47ba-9782-6fc08b539096"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 22:42:53.828567 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.828528    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/81a0b367-da2d-47ba-9782-6fc08b539096-kube-api-access-2cdzj\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:53.828567 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:53.828565    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81a0b367-da2d-47ba-9782-6fc08b539096-maas-api-tls\") on node \"ip-10-0-131-4.ec2.internal\" DevicePath \"\""
Jul 17 22:42:54.242196 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.242165    2570 generic.go:356] "Generic (PLEG): container finished" podID="81a0b367-da2d-47ba-9782-6fc08b539096" containerID="707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d" exitCode=0
Jul 17 22:42:54.242442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.242216    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"
Jul 17 22:42:54.242442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.242255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" event={"ID":"81a0b367-da2d-47ba-9782-6fc08b539096","Type":"ContainerDied","Data":"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"}
Jul 17 22:42:54.242442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.242313    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2" event={"ID":"81a0b367-da2d-47ba-9782-6fc08b539096","Type":"ContainerDied","Data":"1054696a75f298161b701546c9fb088e73d38eef652bb9638ce65e152406d57f"}
Jul 17 22:42:54.242442 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.242342    2570 scope.go:117] "RemoveContainer" containerID="707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"
Jul 17 22:42:54.251226 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.251207    2570 scope.go:117] "RemoveContainer" containerID="707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"
Jul 17 22:42:54.251514 ip-10-0-131-4 kubenswrapper[2570]: E0717 22:42:54.251493    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d\": container with ID starting with 707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d not found: ID does not exist" containerID="707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"
Jul 17 22:42:54.251561 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.251524    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d"} err="failed to get container status \"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d\": rpc error: code = NotFound desc = could not find container \"707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d\": container with ID starting with 707b794c487b0ef39df41c6de624ea4c4114fdac304592defe708982c37d815d not found: ID does not exist"
Jul 17 22:42:54.277057 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.276976    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:42:54.279596 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:54.279572    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fb05ec-6854cbd984-88pq2"]
Jul 17 22:42:56.008948 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:42:56.008915    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a0b367-da2d-47ba-9782-6fc08b539096" path="/var/lib/kubelet/pods/81a0b367-da2d-47ba-9782-6fc08b539096/volumes"
Jul 17 22:43:09.414086 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:09.414054    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6784666db5-752l9_d2fac992-39b4-4565-89a8-09c5bd681bf4/authorino/0.log"
Jul 17 22:43:15.162286 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:15.162255    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4jgb2_5b088a83-7a41-4e0b-8bae-b83dc05a0ae0/server/0.log"
Jul 17 22:43:15.525692 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:15.525585    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff9999cf-hjpbs_949b7e7d-989f-4f5a-a358-4c89aefb7c0e/copy-manifests/0.log"
Jul 17 22:43:15.532452 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:15.532428    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff9999cf-hjpbs_949b7e7d-989f-4f5a-a358-4c89aefb7c0e/manager/0.log"
Jul 17 22:43:16.576889 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:16.576851    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-5abe32-whf4j_11637886-7f9f-41c1-b394-61ebbe71c2b4/revoke-keys/0.log"
Jul 17 22:43:16.684751 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:16.684723    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-bf8fd3-z8c5w_0cde7473-12d9-4257-b59c-708a7367cbcc/revoke-keys/0.log"
Jul 17 22:43:17.038177 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:17.038152    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-4ccee5-lmt2n_0a724afb-283f-44e6-8326-b374577188bf/revoke-keys/0.log"
Jul 17 22:43:17.374923 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:17.374835    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-a56653-pb78l_039c6b2c-99bb-4cdc-a05a-1148f1dda3f7/revoke-keys/0.log"
Jul 17 22:43:17.494367 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:17.494342    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-fb05ec-x9j8x_a5dbf7c4-04b5-41f7-848f-f0bf363ea976/revoke-keys/0.log"
Jul 17 22:43:18.364540 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.364511    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/util/0.log"
Jul 17 22:43:18.370957 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.370928    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/pull/0.log"
Jul 17 22:43:18.376890 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.376873    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/extract/0.log"
Jul 17 22:43:18.489460 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.489424    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/pull/0.log"
Jul 17 22:43:18.498339 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.498314    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/extract/0.log"
Jul 17 22:43:18.505981 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.505965    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/util/0.log"
Jul 17 22:43:18.622975 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.622898    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/util/0.log"
Jul 17 22:43:18.630565 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.630540    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/pull/0.log"
Jul 17 22:43:18.638343 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.638321    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/extract/0.log"
Jul 17 22:43:18.753949 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.753920    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/util/0.log"
Jul 17 22:43:18.760856 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.760833    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/pull/0.log"
Jul 17 22:43:18.767651 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.767631    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/extract/0.log"
Jul 17 22:43:18.889718 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:18.889640    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6784666db5-752l9_d2fac992-39b4-4565-89a8-09c5bd681bf4/authorino/0.log"
Jul 17 22:43:20.325146 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:20.325114    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fdd95b7f-wmthq_b6802050-3109-4456-a133-5e2897a626dd/kube-auth-proxy/0.log"
Jul 17 22:43:20.906923 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:20.906895    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-95685859b-f5ml8_04d1086c-95a3-480d-bf97-637d78ab3117/router/0.log"
Jul 17 22:43:21.363021 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:21.362995    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-29c7b_a37baea9-e8e8-4d5f-8ac2-303064e91866/main/0.log"
Jul 17 22:43:21.689493 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:21.689417    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dqpnj_cd5952d5-aa25-4c56-86ac-28fef0b7e74a/main/0.log"
Jul 17 22:43:21.804100 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:21.804069    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-x5vtw_7616d580-de1b-4c83-8989-7fd447367969/main/0.log"
Jul 17 22:43:31.054571 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:31.054538    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rnn57_df12f5bb-4ab5-4df2-899e-5b6745e066aa/global-pull-secret-syncer/0.log"
Jul 17 22:43:31.146285 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:31.146252    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8gnd2_7104a909-2950-4f03-ac11-04d10d94d5fa/konnectivity-agent/0.log"
Jul 17 22:43:31.259113 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:31.259076    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-4.ec2.internal_9b7594f29e16e38aefd9e13645c1b3bc/haproxy/0.log"
Jul 17 22:43:35.707266 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.707235    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/extract/0.log"
Jul 17 22:43:35.733844 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.733814    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/util/0.log"
Jul 17 22:43:35.756819 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.756796    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nkdm_a27ae53a-3206-43a3-b33e-2bab98c46bd9/pull/0.log"
Jul 17 22:43:35.796462 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.796440    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/extract/0.log"
Jul 17 22:43:35.820162 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.820137    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/util/0.log"
Jul 17 22:43:35.851527 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.851496    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06k5zq_24f44a34-6f8f-4836-bd24-2a98a586041f/pull/0.log"
Jul 17 22:43:35.880666 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.880638    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/extract/0.log"
Jul 17 22:43:35.904430 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.904401    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/util/0.log"
Jul 17 22:43:35.943938 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.943910    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cnvg8_e83f8729-d4a6-4552-89ac-26e0fd5225f3/pull/0.log"
Jul 17 22:43:35.974098 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:35.974029    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/extract/0.log"
Jul 17 22:43:36.005084 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:36.005055    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/util/0.log"
Jul 17 22:43:36.030856 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:36.030826    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l5lpn_08dcfb62-473d-4cdb-bde3-19be6f4f114e/pull/0.log"
Jul 17 22:43:36.334114 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:36.334074    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6784666db5-752l9_d2fac992-39b4-4565-89a8-09c5bd681bf4/authorino/0.log"
Jul 17 22:43:38.487131 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:38.487098    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-sjstb_8ba9e578-8318-4518-8595-e2c8fe36dac0/cluster-monitoring-operator/0.log"
Jul 17 22:43:38.789182 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:38.789157    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg87s_4218d713-9c7c-4ff3-be9f-944dfaf65a59/node-exporter/0.log"
Jul 17 22:43:38.817533 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:38.817510    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg87s_4218d713-9c7c-4ff3-be9f-944dfaf65a59/kube-rbac-proxy/0.log"
Jul 17 22:43:38.847415 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:38.847388    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg87s_4218d713-9c7c-4ff3-be9f-944dfaf65a59/init-textfile/0.log"
Jul 17 22:43:41.435112 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435074    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"]
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435392    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5dbf7c4-04b5-41f7-848f-f0bf363ea976" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435403    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5dbf7c4-04b5-41f7-848f-f0bf363ea976" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435415    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a0b367-da2d-47ba-9782-6fc08b539096" containerName="maas-api"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435421    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a0b367-da2d-47ba-9782-6fc08b539096" containerName="maas-api"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435432    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435437    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435447    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435452    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8690676e-c66f-4ba3-9bb7-291cde9ff653" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435460    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435466    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435473    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435477    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435518 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435524    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a0b367-da2d-47ba-9782-6fc08b539096" containerName="maas-api"
Jul 17 22:43:41.435967 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435534    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5dbf7c4-04b5-41f7-848f-f0bf363ea976" containerName="revoke-keys"
Jul 17 22:43:41.435967 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435540    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435967 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435546    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.435967 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.435551    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a567e542-f062-42e9-8b64-94dbae5f368f" containerName="revoke-keys"
Jul 17 22:43:41.439940 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.439920    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.442193 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.442169    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-728z5\"/\"openshift-service-ca.crt\""
Jul 17 22:43:41.443056 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.443036    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-728z5\"/\"default-dockercfg-jpndz\""
Jul 17 22:43:41.443163 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.443072    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-728z5\"/\"kube-root-ca.crt\""
Jul 17 22:43:41.449282 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.449253    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"]
Jul 17 22:43:41.520092 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.520062    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/1.log"
Jul 17 22:43:41.526227 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.526201    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tkj7z_aa6a3983-ffc9-40ce-b007-a07b810ed1e3/console-operator/2.log"
Jul 17 22:43:41.538147 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.538120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-lib-modules\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.538292 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.538152    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-proc\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.538292 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.538172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pftb\" (UniqueName: \"kubernetes.io/projected/3a88b028-1795-4ad5-ae5d-7212358a625b-kube-api-access-2pftb\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.538292 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.538195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-sys\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.538292 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.538270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-podres\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639411 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-sys\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639601 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-podres\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639601 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-sys\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639601 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-lib-modules\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639601 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-proc\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639813 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639602    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-podres\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639813 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-proc\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639813 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a88b028-1795-4ad5-ae5d-7212358a625b-lib-modules\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.639813 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.639662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pftb\" (UniqueName: \"kubernetes.io/projected/3a88b028-1795-4ad5-ae5d-7212358a625b-kube-api-access-2pftb\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.648056 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.648037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pftb\" (UniqueName: \"kubernetes.io/projected/3a88b028-1795-4ad5-ae5d-7212358a625b-kube-api-access-2pftb\") pod \"perf-node-gather-daemonset-5w29d\" (UID: \"3a88b028-1795-4ad5-ae5d-7212358a625b\") " pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.750793 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.750703    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:41.887240 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:41.887216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"]
Jul 17 22:43:41.888761 ip-10-0-131-4 kubenswrapper[2570]: W0717 22:43:41.888735    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a88b028_1795_4ad5_ae5d_7212358a625b.slice/crio-bf4e8b1478892d5757d6967125604e8e1e21d8c0e744e12ddc9f01ca89f108e2 WatchSource:0}: Error finding container bf4e8b1478892d5757d6967125604e8e1e21d8c0e744e12ddc9f01ca89f108e2: Status 404 returned error can't find the container with id bf4e8b1478892d5757d6967125604e8e1e21d8c0e744e12ddc9f01ca89f108e2
Jul 17 22:43:42.493668 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:42.493631    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d" event={"ID":"3a88b028-1795-4ad5-ae5d-7212358a625b","Type":"ContainerStarted","Data":"7c95acc262137aecfe548e92a4b3abe7e872fa9482a1245c3ec826a79591ac1f"}
Jul 17 22:43:42.494161 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:42.493696    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d" event={"ID":"3a88b028-1795-4ad5-ae5d-7212358a625b","Type":"ContainerStarted","Data":"bf4e8b1478892d5757d6967125604e8e1e21d8c0e744e12ddc9f01ca89f108e2"}
Jul 17 22:43:42.494161 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:42.493769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:42.512508 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:42.512454    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d" podStartSLOduration=1.512436178 podStartE2EDuration="1.512436178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:43:42.511551822 +0000 UTC m=+3490.990504379" watchObservedRunningTime="2026-07-17 22:43:42.512436178 +0000 UTC m=+3490.991388735"
Jul 17 22:43:42.787213 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:42.787186    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-4c5lw_c08e3bea-5c32-4aac-9397-04375fc890ca/volume-data-source-validator/0.log"
Jul 17 22:43:43.924559 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:43.924510    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8mj8j_9310e0ca-04ff-4ef3-9277-0ddcd7d7891c/dns/0.log"
Jul 17 22:43:43.946340 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:43.946307    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8mj8j_9310e0ca-04ff-4ef3-9277-0ddcd7d7891c/kube-rbac-proxy/0.log"
Jul 17 22:43:43.970200 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:43.970170    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hkgbn_45105e01-7ce4-4351-8485-20ea0a18d1f3/dns-node-resolver/0.log"
Jul 17 22:43:44.649770 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:44.649728    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2vxh_e5e6c285-6810-4a59-aa56-a8572a296881/node-ca/0.log"
Jul 17 22:43:45.840962 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:45.840924    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fdd95b7f-wmthq_b6802050-3109-4456-a133-5e2897a626dd/kube-auth-proxy/0.log"
Jul 17 22:43:46.013961 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:46.013931    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-95685859b-f5ml8_04d1086c-95a3-480d-bf97-637d78ab3117/router/0.log"
Jul 17 22:43:46.789731 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:46.789700    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmwqb_d3b6db22-9111-4be1-914a-d9b20fe23666/serve-healthcheck-canary/0.log"
Jul 17 22:43:47.357252 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:47.357222    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v6kxc_51e1534b-5606-4852-b4bc-4248d1d138f7/insights-operator/1.log"
Jul 17 22:43:47.358909 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:47.358890    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v6kxc_51e1534b-5606-4852-b4bc-4248d1d138f7/insights-operator/0.log"
Jul 17 22:43:47.445310 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:47.445283    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8xktq_87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9/kube-rbac-proxy/0.log"
Jul 17 22:43:47.475547 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:47.475514    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8xktq_87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9/exporter/0.log"
Jul 17 22:43:47.498102 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:47.498074    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8xktq_87d1d9d0-c5fe-4dc6-9ffe-b9ca2a401de9/extractor/0.log"
Jul 17 22:43:48.509017 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:48.508990    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-728z5/perf-node-gather-daemonset-5w29d"
Jul 17 22:43:50.288916 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:50.288888    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4jgb2_5b088a83-7a41-4e0b-8bae-b83dc05a0ae0/server/0.log"
Jul 17 22:43:50.498497 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:50.498471    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff9999cf-hjpbs_949b7e7d-989f-4f5a-a358-4c89aefb7c0e/manager/0.log"
Jul 17 22:43:50.523902 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:50.523877    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff9999cf-hjpbs_949b7e7d-989f-4f5a-a358-4c89aefb7c0e/copy-manifests/0.log"
Jul 17 22:43:52.031892 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:52.031808    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68687b8cf-skzhz_28f7c021-4c32-45b7-b7bc-fe8eb9b665ab/manager/1.log"
Jul 17 22:43:52.032373 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:52.032353    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68687b8cf-skzhz_28f7c021-4c32-45b7-b7bc-fe8eb9b665ab/manager/0.log"
Jul 17 22:43:52.053560 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:52.053533    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5fg9r_d0f7e675-9112-4f4a-a744-8a8f7a65746f/openshift-lws-operator/0.log"
Jul 17 22:43:52.114075 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:52.114045    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fdd95b7f-wmthq_b6802050-3109-4456-a133-5e2897a626dd/kube-auth-proxy/0.log"
Jul 17 22:43:52.235486 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:52.235453    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-95685859b-f5ml8_04d1086c-95a3-480d-bf97-637d78ab3117/router/0.log"
Jul 17 22:43:53.635789 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:53.635762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fdd95b7f-wmthq_b6802050-3109-4456-a133-5e2897a626dd/kube-auth-proxy/0.log"
Jul 17 22:43:53.777324 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:53.777291    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-95685859b-f5ml8_04d1086c-95a3-480d-bf97-637d78ab3117/router/0.log"
Jul 17 22:43:57.570445 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:57.570398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mvbp4_26c90da4-e4d1-420a-88ab-4fb8b73da803/kube-storage-version-migrator-operator/1.log"
Jul 17 22:43:57.571481 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:57.571460    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mvbp4_26c90da4-e4d1-420a-88ab-4fb8b73da803/kube-storage-version-migrator-operator/0.log"
Jul 17 22:43:59.090919 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.090890    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/kube-multus-additional-cni-plugins/0.log"
Jul 17 22:43:59.120072 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.120035    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/egress-router-binary-copy/0.log"
Jul 17 22:43:59.142687 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.142656    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/cni-plugins/0.log"
Jul 17 22:43:59.171125 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.171100    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/bond-cni-plugin/0.log"
Jul 17 22:43:59.197165 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.197139    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/routeoverride-cni/0.log"
Jul 17 22:43:59.226279 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.226253    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/whereabouts-cni-bincopy/0.log"
Jul 17 22:43:59.251260 ip-10-0-131-4 kubenswrapper[2570]: I0717 22:43:59.251235    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh5j2_9c96e3ab-1a01-462f-8e8f-2a3c660449a5/whereabouts-cni/0.log"