Jul 18 02:40:02.185548 ip-10-0-136-56 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 02:40:02.542663 ip-10-0-136-56 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 02:40:02.542663 ip-10-0-136-56 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 02:40:02.542663 ip-10-0-136-56 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 02:40:02.542663 ip-10-0-136-56 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 02:40:02.542663 ip-10-0-136-56 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 02:40:02.544846 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.544720    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 02:40:02.549427 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549412    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.549427 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549427    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549431    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549434    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549437    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549440    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549443    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549446    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549451    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549454    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549456    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549459    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549461    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549464    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549466    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549469    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549471    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549474    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549477    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549480    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549488    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.549487 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549491    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549494    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549497    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549500    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549503    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549506    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549508    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549511    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549513    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549515    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549518    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549520    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549523    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549525    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549527    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549530    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549532    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549535    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549537    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.549986 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549541    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549545    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549547    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549550    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549552    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549555    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549557    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549559    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549562    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549564    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549567    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549570    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549572    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549575    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549577    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549580    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549583    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549585    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549588    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549590    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.550454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549593    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549596    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549598    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549601    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549603    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549606    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549611    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549614    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549618    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549621    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549624    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549627    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549630    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549632    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549635    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549637    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549640    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549642    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549645    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.550944 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549647    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549652    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549655    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549658    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549661    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549663    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549666    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549669    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549672    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549675    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549678    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549681    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549683    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549685    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549688    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549690    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549693    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549695    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549697    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.551411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.549700    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550384    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550390    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550393    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550396    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550399    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550403    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550406    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550410    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550414    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550417    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550420    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550422    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550424    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550427    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550430    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550432    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550435    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550437    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.551867 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550440    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550443    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550447    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550449    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550452    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550455    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550457    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550460    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550463    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550466    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550468    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550471    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550474    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550476    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550479    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550481    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550484    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550486    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550490    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550492    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.552382 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550495    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550498    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550500    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550503    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550505    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550508    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550510    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550512    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550515    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550525    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550529    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550532    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550534    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550537    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550540    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550542    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550545    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550547    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550550    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550552    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.552851 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550555    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550557    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550560    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550562    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550565    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550568    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550570    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550573    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550576    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550578    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550581    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550583    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550586    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550588    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550591    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550593    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550596    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550598    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550601    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550604    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.553345 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550607    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550609    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550612    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550614    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550617    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550619    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550621    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550624    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550626    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550629    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550632    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550635    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550638    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550641    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550643    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550646    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550648    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550651    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550653    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.553859 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550657    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.550660    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551078    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551084    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551087    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551092    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551096    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551099    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551101    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551104    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551109    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551112    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551115    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551118    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551121    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551124    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551126    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551129    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551132    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.554340 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551134    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551137    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551139    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551142    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551144    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551146    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551149    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551151    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551154    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551156    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551158    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551161    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551163    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551165    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551168    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551170    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551173    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551175    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551178    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.554892 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551180    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551183    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551186    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551188    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551190    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551193    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551196    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551198    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551201    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551203    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551206    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551209    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551211    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551214    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551216    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551219    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551221    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551223    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551226    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551228    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.555361 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551231    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551233    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551235    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551238    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551240    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551243    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551245    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551247    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551250    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551252    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551255    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551257    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551259    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551262    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551264    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551267    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551269    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551287    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551290    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551292    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.555844 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551295    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551298    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551301    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551304    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551307    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551309    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551312    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551314    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551318    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551322    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551324    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551327    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551329    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551332    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551335    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551337    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551339    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551342    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551344    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.556333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551346    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551349    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551351    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.551353    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551418    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551430    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551436    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551440    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551444    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551450    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551454    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551458    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551462    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551465    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551468    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551471    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551474    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551477    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551479    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551482    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551485    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551488    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551492    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551494    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 02:40:02.556773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551497    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551500    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551504    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551507    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551509    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551512    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551515    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551518    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551521    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551523    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551526    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551529    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551533    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551536    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551541    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551545    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551549    2567 flags.go:64] FLAG: --enable-server="true"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551554    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551559    2567 flags.go:64] FLAG: --event-burst="100"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551562    2567 flags.go:64] FLAG: --event-qps="50"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551565    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551567    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551570    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551574    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 02:40:02.557341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551577    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551580    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551583    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551585    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551588    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551591    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551594    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551597    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551599    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551602    2567 flags.go:64] FLAG: --feature-gates=""
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551606    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551608    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551611    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551614    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551617    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551620    2567 flags.go:64] FLAG: --help="false"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551623    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551625    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551628    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551631    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551634    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551637    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551640    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 02:40:02.557933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551643    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551646    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551650    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551653    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551656    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551659    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551662    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551664    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551667    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551670    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551672    2567 flags.go:64] FLAG: --lock-file=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551675    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551678    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551680    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551685    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551688    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551690    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551693    2567 flags.go:64] FLAG: --logging-format="text"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551696    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551699    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551702    2567 flags.go:64] FLAG: --manifest-url=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551704    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551708    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551711    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551714    2567 flags.go:64] FLAG: --max-pods="110"
Jul 18 02:40:02.558570 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551717    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551720    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551722    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551725    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551728    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551731    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551733    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551739    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551742    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551746    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551749    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551754    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551759    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551761    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551764    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551767    2567 flags.go:64] FLAG: --port="10250"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551769    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551772    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c5a9bab4e89205c"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551775    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551778    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551781    2567 flags.go:64] FLAG: --register-node="true"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551783    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551786    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551789    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 18 02:40:02.559173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551791    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551794    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551797    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551800    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551803    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551806    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551809    2567 flags.go:64] FLAG: --runonce="false"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551811    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551814    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551817    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551820    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551822    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551825    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551828    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551830    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551835    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551838    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551842    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551845    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551848    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551854    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551857    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551862    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551864    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551867    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 02:40:02.559756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551871    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551873    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551876    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551879    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551882    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551885    2567 flags.go:64] FLAG: --v="2"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551889    2567 flags.go:64] FLAG: --version="false"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551892    2567 flags.go:64] FLAG: --vmodule=""
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551896    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.551899    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552018    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552022    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552026    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552029    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552032    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552034    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552037    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552040    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552042    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552045    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552047    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552050    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.560376 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552054    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552056    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552060    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552063    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552065    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552068    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552071    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552073    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552076    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552079    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552081    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552083    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552086    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552090    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552094    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552098    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552101    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552103    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552106    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.560899 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552109    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552111    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552113    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552116    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552118    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552121    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552123    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552127    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552130    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552133    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552136    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552138    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552141    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552145    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552147    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552151    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552154    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552156    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552159    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552161    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.561411 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552164    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552166    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552169    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552171    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552174    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552176    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552178    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552181    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552183    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552185    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552188    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552190    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552193    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552195    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552198    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552200    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552203    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552205    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552208    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.561883 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552211    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552213    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552216    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552218    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552221    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552223    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552227    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552230    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552233    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552236    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552238    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552241    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552243    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552245    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552248    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552251    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552253    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552255    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552258    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552261    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.562357 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552263    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552265    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552268    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552285    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552288    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552290    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552293    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552295    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.552298    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.552907    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.559669    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.559683    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.559700    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.559706    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 02:40:02.562842 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559759    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559765    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559768    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559771    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559773    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559776    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559779    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559781    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559784    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559786    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559789    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559791    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559795    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559797    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559800    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559803    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559805    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559808    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559810    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559813    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.563179 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559815    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559818    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559820    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559823    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559825    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559828    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559830    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559832    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559835    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559838    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559841    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559844    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559846    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559849    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559851    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559854    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559856    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559858    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559861    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559864    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.563708 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559867    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559870    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559872    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559875    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559877    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559880    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559882    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559885    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559887    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559890    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559892    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559894    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559896    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559899    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559901    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559903    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559906    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559908    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559910    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.564188 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559913    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559915    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559918    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559920    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559922    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559925    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559927    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559929    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559932    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559934    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559937    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559939    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559941    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559944    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559946    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559949    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559951    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559953    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559956    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.564693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559959    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559961    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559964    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559966    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559970    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559973    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559976    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559979    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559981    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559984    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559986    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559989    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559991    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559993    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.559997    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560000    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560003    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560006    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560008    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560010    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.565151 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560013    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.560018    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560130    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560134    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560137    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560140    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560144    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560148    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560151    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560154    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560157    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560159    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560162    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560165    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 02:40:02.565638 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560167    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560170    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560172    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560174    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560177    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560179    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560181    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560184    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560186    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560188    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560191    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560195    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560198    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560201    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560204    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560206    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560208    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560211    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560213    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 02:40:02.566101 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560215    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560218    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560220    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560222    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560225    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560227    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560229    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560232    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560234    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560237    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560239    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560242    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560244    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560247    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560250    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560252    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560255    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560257    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560259    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 02:40:02.566876 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560263    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560266    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560268    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560285    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560289    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560291    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560294    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560297    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560300    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560302    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560305    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560307    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560309    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560312    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560315    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560318    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560320    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560322    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560325    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560327    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 02:40:02.567565 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560329    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560332    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560334    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560336    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560339    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560342    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560344    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560347    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560349    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560352    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560354    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560356    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560359    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560361    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560363    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560366    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560370    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560373    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560376    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560378    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 02:40:02.568073 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560380    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560383    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560385    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560388    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560390    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560393    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560395    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560398    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:02.560400    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.560405    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.560496    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.562540    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.563848    2567 server.go:1019] "Starting client certificate rotation"
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.563944    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 02:40:02.568578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.563983    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 02:40:02.568940 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.567573    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 02:40:02.571455 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.571436    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 02:40:02.581857 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.581840    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 18 02:40:02.584596 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.584580    2567 log.go:25] "Validated CRI v1 image API"
Jul 18 02:40:02.585441 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.585427    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 02:40:02.588118 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.588092    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e86ce40a-df4f-45b8-8ade-4148b4e6e9f5:/dev/nvme0n1p3 f05b63be-63e6-4c8c-b0b6-5c9d5ae5ae5b:/dev/nvme0n1p4]
Jul 18 02:40:02.588177 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.588120    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 02:40:02.594150 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.594026    2567 manager.go:216] Machine: {Timestamp:2026-07-18 02:40:02.59293299 +0000 UTC m=+0.292692702 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104215 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2924eeb824a176d20811c73cbab30e SystemUUID:ec2924ee-b824-a176-d208-11c73cbab30e BootID:863e31eb-69cc-4785-80c2-b5bc51cdd2e8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:57:e8:82:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:57:e8:82:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:36:9b:2f:76:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 02:40:02.594150 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.594144    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 02:40:02.594299 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.594233    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 02:40:02.595167 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.595141    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 02:40:02.595322 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.595169    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-56.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 02:40:02.595852 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.595842    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 02:40:02.595882 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.595854    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 02:40:02.595882 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.595865    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 02:40:02.596377 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.596361    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 02:40:02.596584 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.596573    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 02:40:02.597779 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.597769    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 02:40:02.601490 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601478    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 02:40:02.601610 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601601    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 02:40:02.601640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601630    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 02:40:02.601669 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601649    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 02:40:02.601669 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601661    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 02:40:02.601724 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601670    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 18 02:40:02.601724 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.601680    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 02:40:02.602017 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.602006    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 02:40:02.602062 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.602023    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 02:40:02.604799 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.604770    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 02:40:02.606730 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.606712    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 02:40:02.606822 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.606759    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 02:40:02.607897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607882    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607899    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607906    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607911    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607919    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607925    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607933    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607939    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 02:40:02.607945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607945    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 02:40:02.608158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607952    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 02:40:02.608158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607964    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 02:40:02.608158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.607969    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 02:40:02.608468 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.608457    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 02:40:02.608515 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.608470    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 02:40:02.611765 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.611750    2567 server.go:1268] "Started kubelet"
Jul 18 02:40:02.611842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.611807    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 02:40:02.611937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.611886    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 02:40:02.612002 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.611963    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 02:40:02.612400 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.612380    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-56.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 02:40:02.612400 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.612383    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 02:40:02.612665 ip-10-0-136-56 systemd[1]: Started Kubernetes Kubelet.
Jul 18 02:40:02.612805 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.612662    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 02:40:02.613574 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.613550    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 02:40:02.614192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.614160    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 02:40:02.617624 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.617592    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 02:40:02.619330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.618496    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-56.ec2.internal.18c341f61956b2cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-56.ec2.internal,UID:ip-10-0-136-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-56.ec2.internal,},FirstTimestamp:2026-07-18 02:40:02.611720907 +0000 UTC m=+0.311480620,LastTimestamp:2026-07-18 02:40:02.611720907 +0000 UTC m=+0.311480620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-56.ec2.internal,}"
Jul 18 02:40:02.619752 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.619732    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 02:40:02.619752 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.619745    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 02:40:02.619903 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.619792    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:02.620456 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620435    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 02:40:02.620536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620464    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 02:40:02.620536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620482    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 02:40:02.620644 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620585    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 02:40:02.620644 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620594    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 02:40:02.620644 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.620613    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxgf7"
Jul 18 02:40:02.621116 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621101    2567 factory.go:55] Registering systemd factory
Jul 18 02:40:02.621116 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621116    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 18 02:40:02.621358 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621342    2567 factory.go:153] Registering CRI-O factory
Jul 18 02:40:02.621422 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621361    2567 factory.go:223] Registration of the crio container factory successfully
Jul 18 02:40:02.621422 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621403    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 02:40:02.621422 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621422    2567 factory.go:103] Registering Raw factory
Jul 18 02:40:02.621526 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621432    2567 manager.go:1196] Started watching for new ooms in manager
Jul 18 02:40:02.621815 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.621804    2567 manager.go:349] Starting recovery of all containers
Jul 18 02:40:02.625028 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.624745    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 02:40:02.625583 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.625549    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 02:40:02.628894 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.628868    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxgf7"
Jul 18 02:40:02.632546 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.632529    2567 manager.go:354] Recovery completed
Jul 18 02:40:02.636806 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.636793    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.638385 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638368    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.638446 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638395    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.638446 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638405    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.638818 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638805    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 02:40:02.638866 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638819    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 02:40:02.638866 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638832    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 02:40:02.638937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.638874    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.639495 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.639479    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.639556 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.639507    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.639556 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.639522    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.640179 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.640124    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-56.ec2.internal.18c341f61aed863a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-56.ec2.internal,UID:ip-10-0-136-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-56.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-56.ec2.internal,},FirstTimestamp:2026-07-18 02:40:02.63838265 +0000 UTC m=+0.338142361,LastTimestamp:2026-07-18 02:40:02.63838265 +0000 UTC m=+0.338142361,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-56.ec2.internal,}"
Jul 18 02:40:02.640850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.640837    2567 policy_none.go:49] "None policy: Start"
Jul 18 02:40:02.640923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.640861    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 02:40:02.640923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.640876    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 02:40:02.642884 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.642871    2567 policy_none.go:47] "Start"
Jul 18 02:40:02.680029 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.679851    2567 manager.go:337] "Starting Device Plugin manager"
Jul 18 02:40:02.680143 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.680053    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 02:40:02.680143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680067    2567 server.go:87] "Starting device plugin registration server"
Jul 18 02:40:02.680301 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680289    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 02:40:02.680345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680303    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 02:40:02.680428 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680411    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 02:40:02.680512 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680496    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 02:40:02.680512 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.680505    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 02:40:02.680992 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.680974    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 02:40:02.681058 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.681030    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:02.718442 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.718408    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 02:40:02.727203 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.719752    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 02:40:02.727203 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.719784    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 02:40:02.727203 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.719806    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 02:40:02.727203 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.719837    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 02:40:02.727203 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.722090    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 02:40:02.781080 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.781058    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.781895 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.781880    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.781990 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.781918    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.781990 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.781935    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.781990 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.781964    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.789878 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.789864    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.789942 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.789885    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-56.ec2.internal\": node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:02.803848 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.803797    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:02.820428 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.820404    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"]
Jul 18 02:40:02.820502 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.820463    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.820757 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.820741    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.820818 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.820769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.821149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.821134    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.821223 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.821163    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.821223 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.821176    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.823640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.823625    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.823747 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.823733    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.823791 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.823766    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.824341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824329    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.824400 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824354    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.824400 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824364    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.824710 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824686    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.824784 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824719    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.824784 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.824735    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.826964 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.826949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.827039 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.826972    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 02:40:02.827619 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.827605    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 02:40:02.827700 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.827633    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 02:40:02.827700 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.827644    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID"
Jul 18 02:40:02.851846 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.851826    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-56.ec2.internal\" not found" node="ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.856154 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.856138    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-56.ec2.internal\" not found" node="ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.904052 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:02.904033    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:02.921266 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.921250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.921333 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.921287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.921333 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.921316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:02.921400 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:02.921312    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/642f239be333f1b4f87bebc7e70f74e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"642f239be333f1b4f87bebc7e70f74e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.004953 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.004933    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.022258 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.022237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/296182ac9f69666f6c3b613faa7d2ac3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"296182ac9f69666f6c3b613faa7d2ac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.105722 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.105657    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.122987 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.122962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/296182ac9f69666f6c3b613faa7d2ac3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"296182ac9f69666f6c3b613faa7d2ac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.123046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.123002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/296182ac9f69666f6c3b613faa7d2ac3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"296182ac9f69666f6c3b613faa7d2ac3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.155109 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.155091    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.158892 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.158879    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.206249 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.206225    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.306786 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.306751    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.407336 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.407230    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.507886 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.507859    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.563393 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.563367    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 02:40:03.563818 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.563496    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 02:40:03.608492 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.608465    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.612267 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.612251    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 02:40:03.634069 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.634045    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 02:35:03 +0000 UTC" deadline="2028-05-02 22:11:01.755373916 +0000 UTC"
Jul 18 02:40:03.634163 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.634070    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15715h30m58.121306648s"
Jul 18 02:40:03.709383 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.709316    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.758369 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:03.758339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296182ac9f69666f6c3b613faa7d2ac3.slice/crio-93890e6477719fc81f12b1d31f1f76fce63d258b90116a7d10afc30c3660840b WatchSource:0}: Error finding container 93890e6477719fc81f12b1d31f1f76fce63d258b90116a7d10afc30c3660840b: Status 404 returned error can't find the container with id 93890e6477719fc81f12b1d31f1f76fce63d258b90116a7d10afc30c3660840b
Jul 18 02:40:03.759332 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:03.759308    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642f239be333f1b4f87bebc7e70f74e5.slice/crio-758f3b4598d3458f0af0c0fd78ac990f535cd0fe893c9ef0dd3f574c755d53fd WatchSource:0}: Error finding container 758f3b4598d3458f0af0c0fd78ac990f535cd0fe893c9ef0dd3f574c755d53fd: Status 404 returned error can't find the container with id 758f3b4598d3458f0af0c0fd78ac990f535cd0fe893c9ef0dd3f574c755d53fd
Jul 18 02:40:03.765223 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.765208    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:40:03.810456 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:03.810430    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found"
Jul 18 02:40:03.899630 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.899604    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 02:40:03.920657 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.920624    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.931964 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.931943    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 02:40:03.933459 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.933447    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"
Jul 18 02:40:03.942151 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:03.942131    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 02:40:05.172828 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.172801    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 02:40:05.651425 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.651399    2567 apiserver.go:52] "Watching apiserver"
Jul 18 02:40:05.658448 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.658423    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 02:40:05.659924 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.659891    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2","openshift-cluster-node-tuning-operator/tuned-wc75q","openshift-image-registry/node-ca-82k4d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal","openshift-multus/multus-m44rf","openshift-multus/network-metrics-daemon-jstt2","openshift-network-diagnostics/network-check-target-2w5bm","kube-system/konnectivity-agent-8xm9b","kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal","openshift-dns/node-resolver-thfh5","openshift-multus/multus-additional-cni-plugins-sbs54","openshift-network-operator/iptables-alerter-g2rrt","openshift-ovn-kubernetes/ovnkube-node-k7r88","kube-system/global-pull-secret-syncer-pzv7t"]
Jul 18 02:40:05.662385 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.662362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.664670 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.664645    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.664773 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.664758    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.664838 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.664650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.664956 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.664939    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6hwpp\""
Jul 18 02:40:05.666642 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.666610    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.666959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.666938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.667185 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667165    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zf9mr\""
Jul 18 02:40:05.667326 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667306    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 02:40:05.667505 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667484    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 02:40:05.667575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667521    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 02:40:05.667629 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667493    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.667804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.667787    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 02:40:05.668865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.668831    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.669244 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.669225    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 02:40:05.669473 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.669455    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 02:40:05.669587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.669564    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.669681 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.669626    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pd8fw\""
Jul 18 02:40:05.669681 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.669668    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.669788 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.669730    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:05.680475 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-netns\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680475 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-script-lib\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-netd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-host\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.680694 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-node-log\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680697    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-env-overrides\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4rd\" (UniqueName: \"kubernetes.io/projected/7bc225be-fc5d-4a8e-8810-c49a78886682-kube-api-access-2k4rd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680762    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-etc-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-bin\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-config\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-systemd-units\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.680897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-var-lib-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcn8q\" (UniqueName: \"kubernetes.io/projected/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-kube-api-access-wcn8q\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-hosts-file\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.680963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzbg\" (UniqueName: \"kubernetes.io/projected/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-kube-api-access-tmzbg\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-serviceca\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.681140 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-kubelet\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681158    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-slash\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-systemd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681242    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-ovn\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-kubelet-config\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-dbus\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.681350    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-tmp-dir\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.681432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-log-socket\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.681808 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.681454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bc225be-fc5d-4a8e-8810-c49a78886682-ovn-node-metrics-cert\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.682675 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.682653    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.682821 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.682802    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d9vnz\""
Jul 18 02:40:05.682974 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.682946    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 02:40:05.683102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.682953    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 02:40:05.683323 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.683304    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.684038 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.684020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.684889 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.684864    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 02:40:05.685905 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.685887    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 02:40:05.686409 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.686382    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8rn4k\""
Jul 18 02:40:05.686490 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.686474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:05.686594 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.686572    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:05.686688 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.686622    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 02:40:05.689284 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.689080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.691080 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.691060    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.691302 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.691286    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.691345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.691299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6ngvk\""
Jul 18 02:40:05.691376 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.691340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.693447 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.693293    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.693447 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.693312    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 02:40:05.693447 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.693335    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c9f2v\""
Jul 18 02:40:05.693627 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.693565    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.693853 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.693838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.696567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.695829    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 02:40:05.696567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.696175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c57cp\""
Jul 18 02:40:05.696567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.696175    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.696567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.696523    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 02:40:05.698162 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.698145    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 02:40:05.698259 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.698180    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6qcc8\""
Jul 18 02:40:05.698413 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.698397    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 02:40:05.698469 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.698421    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 02:40:05.701750 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.701730    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b4wx7"
Jul 18 02:40:05.710870 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.710854    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b4wx7"
Jul 18 02:40:05.770192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.770165    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 02:40:05.773520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.773471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" event={"ID":"296182ac9f69666f6c3b613faa7d2ac3","Type":"ContainerStarted","Data":"93890e6477719fc81f12b1d31f1f76fce63d258b90116a7d10afc30c3660840b"}
Jul 18 02:40:05.774426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.774405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"642f239be333f1b4f87bebc7e70f74e5","Type":"ContainerStarted","Data":"758f3b4598d3458f0af0c0fd78ac990f535cd0fe893c9ef0dd3f574c755d53fd"}
Jul 18 02:40:05.781740 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-script-lib\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.781837 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-cnibin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.781837 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-conf\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.781837 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-conf-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.781837 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4rd\" (UniqueName: \"kubernetes.io/projected/7bc225be-fc5d-4a8e-8810-c49a78886682-kube-api-access-2k4rd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-device-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-etc-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.781941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-config\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-netns\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.782042 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-etc-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-cnibin\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtkd\" (UniqueName: \"kubernetes.io/projected/bd042130-da2c-4cc3-a783-d1e8cf320610-kube-api-access-fjtkd\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-socket-dir-parent\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzbg\" (UniqueName: \"kubernetes.io/projected/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-kube-api-access-tmzbg\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-sys\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-sys-fs\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-slash\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-ovn\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.782303    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:05.782340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-dbus\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.782387    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:06.282365837 +0000 UTC m=+2.934417543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-slash\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-host\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-script-lib\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwxln\" (UniqueName: \"kubernetes.io/projected/da5aa183-5dc0-482a-b829-8eca8ba324f9-kube-api-access-mwxln\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-ovnkube-config\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-ovn\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57gq\" (UniqueName: \"kubernetes.io/projected/01374b45-7dac-42c7-a581-e8779a60b45f-kube-api-access-j57gq\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-dbus\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-socket-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782592    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-tmp-dir\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-log-socket\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bc225be-fc5d-4a8e-8810-c49a78886682-ovn-node-metrics-cert\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-kubernetes\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.782834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-log-socket\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-lib-modules\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da5aa183-5dc0-482a-b829-8eca8ba324f9-iptables-alerter-script\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-netns\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782836    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-tmp-dir\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-var-lib-kubelet\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-netns\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da5aa183-5dc0-482a-b829-8eca8ba324f9-host-slash\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782908    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-multus-daemon-config\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.782951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-etc-kubernetes\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783010    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 02:40:05.783566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-netd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-host\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-run\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-cni-binary-copy\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783237    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-netd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-hostroot\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-host\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-registration-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-node-log\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-env-overrides\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2s8\" (UniqueName: \"kubernetes.io/projected/2df05729-ccdd-45b2-b326-38cbe1d50f6d-kube-api-access-9m2s8\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-system-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-node-log\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-os-release\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784264 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4w7t\" (UniqueName: \"kubernetes.io/projected/75cecb39-6eea-4bf8-9869-864824d55ea4-kube-api-access-l4w7t\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-bin\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-modprobe-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-systemd\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783560    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-cni-bin\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-tuned\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-kubelet\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-system-cni-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bc225be-fc5d-4a8e-8810-c49a78886682-env-overrides\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783685    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-systemd-units\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-var-lib-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-systemd-units\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcn8q\" (UniqueName: \"kubernetes.io/projected/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-kube-api-access-wcn8q\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-var-lib-openvswitch\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783839    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.784835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-k8s-cni-cncf-io\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.783959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-os-release\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-hosts-file\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-serviceca\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mzt\" (UniqueName: \"kubernetes.io/projected/a005930d-bce2-4835-b5ea-9ce2bdf39541-kube-api-access-l4mzt\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-hosts-file\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-kubelet\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-systemd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784170    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-host-kubelet\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-kubelet-config\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe3d93e-7d71-49f5-9369-d246f147fd83-konnectivity-ca\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-kubelet-config\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-multus\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-multus-certs\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784275    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe3d93e-7d71-49f5-9369-d246f147fd83-agent-certs\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.785360 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysconfig\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.785851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784269    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bc225be-fc5d-4a8e-8810-c49a78886682-run-systemd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.785851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-tmp\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.785851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-bin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.785851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.784504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-serviceca\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.786439 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.786423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bc225be-fc5d-4a8e-8810-c49a78886682-ovn-node-metrics-cert\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.790383 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.790366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzbg\" (UniqueName: \"kubernetes.io/projected/45dbdde2-9cdb-41ba-8f14-f38fd703c3e0-kube-api-access-tmzbg\") pod \"node-resolver-thfh5\" (UID: \"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0\") " pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.790769 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.790752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcn8q\" (UniqueName: \"kubernetes.io/projected/20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b-kube-api-access-wcn8q\") pod \"node-ca-82k4d\" (UID: \"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b\") " pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:05.790838 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.790785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4rd\" (UniqueName: \"kubernetes.io/projected/7bc225be-fc5d-4a8e-8810-c49a78886682-kube-api-access-2k4rd\") pod \"ovnkube-node-k7r88\" (UID: \"7bc225be-fc5d-4a8e-8810-c49a78886682\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:05.815747 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.815720    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 02:40:05.884829 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-modprobe-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-systemd\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-tuned\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-kubelet\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-modprobe-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.884969    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-systemd\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-system-cni-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-kubelet\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-system-cni-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-k8s-cni-cncf-io\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-os-release\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885200    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mzt\" (UniqueName: \"kubernetes.io/projected/a005930d-bce2-4835-b5ea-9ce2bdf39541-kube-api-access-l4mzt\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe3d93e-7d71-49f5-9369-d246f147fd83-konnectivity-ca\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-multus\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-multus-certs\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-os-release\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.885332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885332    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe3d93e-7d71-49f5-9369-d246f147fd83-agent-certs\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-k8s-cni-cncf-io\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysconfig\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysconfig\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-tmp\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-bin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885444    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-cnibin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-conf\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-conf-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-device-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885539    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-netns\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885609    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-cnibin\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtkd\" (UniqueName: \"kubernetes.io/projected/bd042130-da2c-4cc3-a783-d1e8cf320610-kube-api-access-fjtkd\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-socket-dir-parent\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-sys\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885722    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-sys-fs\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.886202 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-host\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885773    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwxln\" (UniqueName: \"kubernetes.io/projected/da5aa183-5dc0-482a-b829-8eca8ba324f9-kube-api-access-mwxln\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57gq\" (UniqueName: \"kubernetes.io/projected/01374b45-7dac-42c7-a581-e8779a60b45f-kube-api-access-j57gq\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-conf\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.885903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886055    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-netns\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886083    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-conf-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd042130-da2c-4cc3-a783-d1e8cf320610-cnibin\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-device-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-socket-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-sys\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-kubernetes\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-sys-fs\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-lib-modules\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da5aa183-5dc0-482a-b829-8eca8ba324f9-iptables-alerter-script\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-var-lib-kubelet\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da5aa183-5dc0-482a-b829-8eca8ba324f9-host-slash\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-multus-daemon-config\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-kubernetes\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-etc-kubernetes\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-run\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-cni-binary-copy\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-hostroot\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-registration-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2s8\" (UniqueName: \"kubernetes.io/projected/2df05729-ccdd-45b2-b326-38cbe1d50f6d-kube-api-access-9m2s8\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-system-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886589    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-os-release\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4w7t\" (UniqueName: \"kubernetes.io/projected/75cecb39-6eea-4bf8-9869-864824d55ea4-kube-api-access-l4w7t\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.887945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfe3d93e-7d71-49f5-9369-d246f147fd83-konnectivity-ca\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd042130-da2c-4cc3-a783-d1e8cf320610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-multus\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-socket-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-etc-kubernetes\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-cnibin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-multus-socket-dir-parent\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-host\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-run-multus-certs\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886872    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-hostroot\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886940    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-lib-modules\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-registration-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-system-cni-dir\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886399    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-host-var-lib-cni-bin\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75cecb39-6eea-4bf8-9869-864824d55ea4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da5aa183-5dc0-482a-b829-8eca8ba324f9-host-slash\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887277    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-cni-binary-copy\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01374b45-7dac-42c7-a581-e8779a60b45f-os-release\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.888804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.886328    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-sysctl-d\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887347    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-run\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887294    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a005930d-bce2-4835-b5ea-9ce2bdf39541-var-lib-kubelet\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.887378    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.887432    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:06.387414367 +0000 UTC m=+3.039466046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887462    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da5aa183-5dc0-482a-b829-8eca8ba324f9-iptables-alerter-script\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.887677    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01374b45-7dac-42c7-a581-e8779a60b45f-multus-daemon-config\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.888062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-etc-tuned\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.888211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a005930d-bce2-4835-b5ea-9ce2bdf39541-tmp\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.889684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.889138    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfe3d93e-7d71-49f5-9369-d246f147fd83-agent-certs\") pod \"konnectivity-agent-8xm9b\" (UID: \"bfe3d93e-7d71-49f5-9369-d246f147fd83\") " pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:05.891116 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.891095    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:05.891116 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.891118    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:05.891400 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.891132    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:05.891400 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:05.891187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:06.391170756 +0000 UTC m=+3.043222440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:05.893863 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.893836    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mzt\" (UniqueName: \"kubernetes.io/projected/a005930d-bce2-4835-b5ea-9ce2bdf39541-kube-api-access-l4mzt\") pod \"tuned-wc75q\" (UID: \"a005930d-bce2-4835-b5ea-9ce2bdf39541\") " pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:05.893953 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.893933    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtkd\" (UniqueName: \"kubernetes.io/projected/bd042130-da2c-4cc3-a783-d1e8cf320610-kube-api-access-fjtkd\") pod \"multus-additional-cni-plugins-sbs54\" (UID: \"bd042130-da2c-4cc3-a783-d1e8cf320610\") " pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:05.894763 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.894738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4w7t\" (UniqueName: \"kubernetes.io/projected/75cecb39-6eea-4bf8-9869-864824d55ea4-kube-api-access-l4w7t\") pod \"aws-ebs-csi-driver-node-wptv2\" (UID: \"75cecb39-6eea-4bf8-9869-864824d55ea4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:05.895325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.895255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwxln\" (UniqueName: \"kubernetes.io/projected/da5aa183-5dc0-482a-b829-8eca8ba324f9-kube-api-access-mwxln\") pod \"iptables-alerter-g2rrt\" (UID: \"da5aa183-5dc0-482a-b829-8eca8ba324f9\") " pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:05.895761 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.895745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57gq\" (UniqueName: \"kubernetes.io/projected/01374b45-7dac-42c7-a581-e8779a60b45f-kube-api-access-j57gq\") pod \"multus-m44rf\" (UID: \"01374b45-7dac-42c7-a581-e8779a60b45f\") " pod="openshift-multus/multus-m44rf"
Jul 18 02:40:05.895892 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.895877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2s8\" (UniqueName: \"kubernetes.io/projected/2df05729-ccdd-45b2-b326-38cbe1d50f6d-kube-api-access-9m2s8\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:05.983968 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.983890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-thfh5"
Jul 18 02:40:05.992671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:05.992650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:06.001357 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.001334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82k4d"
Jul 18 02:40:06.007081 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.007053    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m44rf"
Jul 18 02:40:06.014660 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.014642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:06.022158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.022140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wc75q"
Jul 18 02:40:06.030718 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.030700    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2"
Jul 18 02:40:06.042266 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.042249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbs54"
Jul 18 02:40:06.047800 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.047773    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2rrt"
Jul 18 02:40:06.288505 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.288424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:06.288645 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.288601    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:06.288686 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.288665    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:07.288650641 +0000 UTC m=+3.940702320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:06.389519 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.389487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:06.389688 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.389631    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:06.389729 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.389692    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:07.389676493 +0000 UTC m=+4.041728173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:06.490611 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.490573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:06.490797 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.490766    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:06.490797 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.490801    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:06.491001 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.490815    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:06.491001 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:06.490876    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:07.490857805 +0000 UTC m=+4.142909493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:06.714508 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.714416    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 02:35:05 +0000 UTC" deadline="2027-12-30 16:24:36.288471668 +0000 UTC"
Jul 18 02:40:06.714508 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:06.714463    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12733h44m29.574012693s"
Jul 18 02:40:06.785012 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.784955    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01374b45_7dac_42c7_a581_e8779a60b45f.slice/crio-650c685916d0e3c857ee94568e3a234a085658b9d6b9202784d21a1ff49e4dfa WatchSource:0}: Error finding container 650c685916d0e3c857ee94568e3a234a085658b9d6b9202784d21a1ff49e4dfa: Status 404 returned error can't find the container with id 650c685916d0e3c857ee94568e3a234a085658b9d6b9202784d21a1ff49e4dfa
Jul 18 02:40:06.787014 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.786969    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc225be_fc5d_4a8e_8810_c49a78886682.slice/crio-0eee4128e64f35a49557f0cf6f24b92cfa20f3d04a6109f05b546433137853ad WatchSource:0}: Error finding container 0eee4128e64f35a49557f0cf6f24b92cfa20f3d04a6109f05b546433137853ad: Status 404 returned error can't find the container with id 0eee4128e64f35a49557f0cf6f24b92cfa20f3d04a6109f05b546433137853ad
Jul 18 02:40:06.787746 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.787655    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45dbdde2_9cdb_41ba_8f14_f38fd703c3e0.slice/crio-22208dadb86ae16654c7f2e61dfbe4cc3d89077c75c3607f3f30078536864b78 WatchSource:0}: Error finding container 22208dadb86ae16654c7f2e61dfbe4cc3d89077c75c3607f3f30078536864b78: Status 404 returned error can't find the container with id 22208dadb86ae16654c7f2e61dfbe4cc3d89077c75c3607f3f30078536864b78
Jul 18 02:40:06.790364 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.790353    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5aa183_5dc0_482a_b829_8eca8ba324f9.slice/crio-e5f43a78323601c784b1010e77af4af9eb5ed2270650d611a0e3d655266169d6 WatchSource:0}: Error finding container e5f43a78323601c784b1010e77af4af9eb5ed2270650d611a0e3d655266169d6: Status 404 returned error can't find the container with id e5f43a78323601c784b1010e77af4af9eb5ed2270650d611a0e3d655266169d6
Jul 18 02:40:06.791113 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.791091    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd042130_da2c_4cc3_a783_d1e8cf320610.slice/crio-c6e7b11e1467c657edd2069ba74c2c9c752ccd59dd07405e73828f14a7c7b629 WatchSource:0}: Error finding container c6e7b11e1467c657edd2069ba74c2c9c752ccd59dd07405e73828f14a7c7b629: Status 404 returned error can't find the container with id c6e7b11e1467c657edd2069ba74c2c9c752ccd59dd07405e73828f14a7c7b629
Jul 18 02:40:06.791760 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.791740    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda005930d_bce2_4835_b5ea_9ce2bdf39541.slice/crio-4d651fa75500b7afa443f47651021c20b86f68e974664d538496dea2e3c8d657 WatchSource:0}: Error finding container 4d651fa75500b7afa443f47651021c20b86f68e974664d538496dea2e3c8d657: Status 404 returned error can't find the container with id 4d651fa75500b7afa443f47651021c20b86f68e974664d538496dea2e3c8d657
Jul 18 02:40:06.792693 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:06.792674    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe3d93e_7d71_49f5_9369_d246f147fd83.slice/crio-5a730b7be9f3c14b0d9859b2acc0e8b202362eb3f0d0a92871e9c6767218d945 WatchSource:0}: Error finding container 5a730b7be9f3c14b0d9859b2acc0e8b202362eb3f0d0a92871e9c6767218d945: Status 404 returned error can't find the container with id 5a730b7be9f3c14b0d9859b2acc0e8b202362eb3f0d0a92871e9c6767218d945
Jul 18 02:40:07.297314 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.296809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:07.297314 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.296943    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:07.297314 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.297257    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:09.297230619 +0000 UTC m=+5.949282299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:07.397973 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.397935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:07.398185 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.398097    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:07.398185 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.398159    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:09.398139967 +0000 UTC m=+6.050191648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:07.498667 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.498630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:07.498846 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.498827    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:07.498915 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.498848    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:07.498915 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.498861    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:07.499097 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.498916    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:09.498898898 +0000 UTC m=+6.150950579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:07.714844 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.714753    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 02:35:05 +0000 UTC" deadline="2028-04-24 07:42:33.561888106 +0000 UTC"
Jul 18 02:40:07.714844 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.714793    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15509h2m25.847099882s"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.770934    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.771090    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.771174    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.771248    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.771320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:07.771731 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:07.771383    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:07.795936 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.795899    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" event={"ID":"296182ac9f69666f6c3b613faa7d2ac3","Type":"ContainerStarted","Data":"6a11085b845b3458600cc1364ec04010dc1cf692d8d94e1cd3e7eef33dd73f25"}
Jul 18 02:40:07.800413 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.800382    2567 generic.go:356] "Generic (PLEG): container finished" podID="642f239be333f1b4f87bebc7e70f74e5" containerID="1ad1d23e5ecb06c5f09e48d0f728a4bd1d61ccd0d766f20d55c6007c5f313df1" exitCode=0
Jul 18 02:40:07.800540 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.800466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"642f239be333f1b4f87bebc7e70f74e5","Type":"ContainerDied","Data":"1ad1d23e5ecb06c5f09e48d0f728a4bd1d61ccd0d766f20d55c6007c5f313df1"}
Jul 18 02:40:07.805767 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.805736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82k4d" event={"ID":"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b","Type":"ContainerStarted","Data":"e72f87432368c4e45ef064728397b4ba6c6348fec67a2047f08f2793f7761856"}
Jul 18 02:40:07.812867 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.812075    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" podStartSLOduration=3.812059021 podStartE2EDuration="3.812059021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:07.811244863 +0000 UTC m=+4.463296567" watchObservedRunningTime="2026-07-18 02:40:07.812059021 +0000 UTC m=+4.464110722"
Jul 18 02:40:07.812867 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.812756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xm9b" event={"ID":"bfe3d93e-7d71-49f5-9369-d246f147fd83","Type":"ContainerStarted","Data":"5a730b7be9f3c14b0d9859b2acc0e8b202362eb3f0d0a92871e9c6767218d945"}
Jul 18 02:40:07.834482 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.834388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerStarted","Data":"c6e7b11e1467c657edd2069ba74c2c9c752ccd59dd07405e73828f14a7c7b629"}
Jul 18 02:40:07.836383 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.836359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m44rf" event={"ID":"01374b45-7dac-42c7-a581-e8779a60b45f","Type":"ContainerStarted","Data":"650c685916d0e3c857ee94568e3a234a085658b9d6b9202784d21a1ff49e4dfa"}
Jul 18 02:40:07.840170 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.840127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2" event={"ID":"75cecb39-6eea-4bf8-9869-864824d55ea4","Type":"ContainerStarted","Data":"d397df60efb0c26360ff0b6089a819481ae81e462e447e41dc35e6e68f80a63e"}
Jul 18 02:40:07.849292 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.849261    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wc75q" event={"ID":"a005930d-bce2-4835-b5ea-9ce2bdf39541","Type":"ContainerStarted","Data":"4d651fa75500b7afa443f47651021c20b86f68e974664d538496dea2e3c8d657"}
Jul 18 02:40:07.853867 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.853840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2rrt" event={"ID":"da5aa183-5dc0-482a-b829-8eca8ba324f9","Type":"ContainerStarted","Data":"e5f43a78323601c784b1010e77af4af9eb5ed2270650d611a0e3d655266169d6"}
Jul 18 02:40:07.858371 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.858350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-thfh5" event={"ID":"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0","Type":"ContainerStarted","Data":"22208dadb86ae16654c7f2e61dfbe4cc3d89077c75c3607f3f30078536864b78"}
Jul 18 02:40:07.872244 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:07.872219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"0eee4128e64f35a49557f0cf6f24b92cfa20f3d04a6109f05b546433137853ad"}
Jul 18 02:40:08.912219 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:08.912152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"642f239be333f1b4f87bebc7e70f74e5","Type":"ContainerStarted","Data":"a74ec939446ed7d722b336af89cada00700f5852cad9bc9c9a2dcf99b0426637"}
Jul 18 02:40:09.315932 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.315770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:09.316101 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.315977    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:09.316101 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.316059    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:13.316039208 +0000 UTC m=+9.968090889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:09.417086 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.417048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:09.417248 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.417212    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:09.417309 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.417279    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:13.417259384 +0000 UTC m=+10.069311067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:09.517596 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.517560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:09.517753 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.517736    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:09.517807 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.517760    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:09.517807 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.517771    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:09.517911 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.517828    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:13.517810425 +0000 UTC m=+10.169862123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:09.768181 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.768090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:09.768334 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.768213    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:09.768601 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.768578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:09.768688 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.768666    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:09.771016 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:09.770996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:09.771132 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:09.771099    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:11.768765 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:11.768728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:11.769260 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:11.768779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:11.769260 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:11.768733    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:11.769260 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:11.768864    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:11.769260 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:11.768962    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:11.769260 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:11.769065    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:13.352708 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.352672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:13.353186 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.352813    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:13.353186 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.352873    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:21.352854601 +0000 UTC m=+18.004906294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:13.454067 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.454033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:13.454229 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.454150    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:13.454229 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.454205    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:21.454187324 +0000 UTC m=+18.106239016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:13.555340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.555307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:13.555509 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.555455    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:13.555509 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.555475    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:13.555509 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.555487    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:13.555654 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.555543    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:21.555523469 +0000 UTC m=+18.207575150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:13.771054 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.769871    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:13.771054 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.769977    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:13.771054 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.770925    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:13.771054 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.771020    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:13.771329 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:13.771155    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:13.771329 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:13.771288    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:15.770340 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:15.770301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:15.770780 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:15.770444    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:15.770851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:15.770822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:15.770932 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:15.770902    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:15.771067 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:15.770961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:15.771067 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:15.771061    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:17.771151 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:17.771117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:17.771151 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:17.771137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:17.771626 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:17.771125    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:17.771626 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:17.771220    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:17.771626 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:17.771326    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:17.771626 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:17.771404    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:19.774277 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:19.774246    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:19.774277 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:19.774275    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:19.774766 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:19.774275    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:19.774766 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:19.774374    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:19.774766 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:19.774449    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:19.774766 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:19.774507    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:21.412409 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.412372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:21.412846 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.412539    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:21.412846 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.412621    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:37.412590906 +0000 UTC m=+34.064642585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:21.513480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.513439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:21.513628 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.513609    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:21.513696 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.513682    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:40:37.513662084 +0000 UTC m=+34.165713767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:21.614662 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.614629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:21.614840 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.614821    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:21.614921 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.614843    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:21.614921 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.614856    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:21.614921 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.614918    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:40:37.614901378 +0000 UTC m=+34.266953058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:21.768345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.768259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:21.768345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.768296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:21.768543 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.768415    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:21.768543 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.768462    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:21.768543 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:21.768508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:21.768652 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:21.768597    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:23.768779 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:23.768749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:23.769283 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:23.768754    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:23.769283 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:23.768883    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:23.769283 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:23.768754    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:23.769283 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:23.768951    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:23.769283 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:23.769028    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:25.767995 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.767801    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:25.768494 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.767798    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:25.768494 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:25.768127    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:25.768494 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.767838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:25.768494 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:25.768213    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:25.768494 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:25.768303    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:25.947684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.947392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82k4d" event={"ID":"20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b","Type":"ContainerStarted","Data":"204607d5a3d0beaed5ffba4937f63ae45798ffe5bf2073481eb0b697cb3dbc71"}
Jul 18 02:40:25.948808 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.948781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xm9b" event={"ID":"bfe3d93e-7d71-49f5-9369-d246f147fd83","Type":"ContainerStarted","Data":"3c2e3d74a2f0e633a0fbf41efb56c57c8b88c1cd4238d281ef7c2379e4e1d02d"}
Jul 18 02:40:25.950318 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.950297    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="16a5aef8bace1626ea2d15970dc2caca029d11ec82c342af4dc477822e4cfc33" exitCode=0
Jul 18 02:40:25.950405 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.950362    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"16a5aef8bace1626ea2d15970dc2caca029d11ec82c342af4dc477822e4cfc33"}
Jul 18 02:40:25.951817 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.951778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m44rf" event={"ID":"01374b45-7dac-42c7-a581-e8779a60b45f","Type":"ContainerStarted","Data":"6ce8f67ca7103bf7c8b320a2d117f25a516ccc37e2a5442ac5fabb0b07933153"}
Jul 18 02:40:25.953556 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.953530    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2" event={"ID":"75cecb39-6eea-4bf8-9869-864824d55ea4","Type":"ContainerStarted","Data":"f05c75e601c818dd8b39176ce3afa89b28b072c2ca710d5ccfca76669a70d0e2"}
Jul 18 02:40:25.955164 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.955141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wc75q" event={"ID":"a005930d-bce2-4835-b5ea-9ce2bdf39541","Type":"ContainerStarted","Data":"ccc1424b1fd5f3e35cdb6e48406db2ca3a806bcfefcb667933a4274c30819284"}
Jul 18 02:40:25.957040 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.957015    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-thfh5" event={"ID":"45dbdde2-9cdb-41ba-8f14-f38fd703c3e0","Type":"ContainerStarted","Data":"743a631952434aa7c7bf358ec7f83e284594cab915582659b3307df3166c6f54"}
Jul 18 02:40:25.958796 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.958781    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:40:25.959097 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.959080    2567 generic.go:356] "Generic (PLEG): container finished" podID="7bc225be-fc5d-4a8e-8810-c49a78886682" containerID="229cd24609caee6b8a9b00ad918b0f098331976f539dfb7e62bf97ad037f4968" exitCode=1
Jul 18 02:40:25.959150 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.959112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"031d7ab43adce901a2cf619dddcc301a9dade9da4d326f2ee406fd279531dddf"}
Jul 18 02:40:25.959192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.959155    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerDied","Data":"229cd24609caee6b8a9b00ad918b0f098331976f539dfb7e62bf97ad037f4968"}
Jul 18 02:40:25.959192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.959186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"ac2fe139af01fba8d8a1520994e1342a85dd05ac8708f0bee4ded2b8d720804d"}
Jul 18 02:40:25.961035 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.960997    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-82k4d" podStartSLOduration=4.286038242 podStartE2EDuration="22.960970762s" totalImagesPullingTime="18.67493252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:25.960521759 +0000 UTC m=+22.612573469" watchObservedRunningTime="2026-07-18 02:40:25.960970762 +0000 UTC m=+22.613022463"
Jul 18 02:40:25.961133 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.961076    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" podStartSLOduration=21.961071234 podStartE2EDuration="21.961071234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:08.927897556 +0000 UTC m=+5.579949261" watchObservedRunningTime="2026-07-18 02:40:25.961071234 +0000 UTC m=+22.613122936"
Jul 18 02:40:25.991831 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:25.991793    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-thfh5" podStartSLOduration=4.659844917 podStartE2EDuration="22.991777873s" totalImagesPullingTime="18.331932956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:25.99142894 +0000 UTC m=+22.643480651" watchObservedRunningTime="2026-07-18 02:40:25.991777873 +0000 UTC m=+22.643829574"
Jul 18 02:40:26.006586 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.006531    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m44rf" podStartSLOduration=4.273331219 podStartE2EDuration="23.006516879s" totalImagesPullingTime="18.73318566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:26.006344389 +0000 UTC m=+22.658396092" watchObservedRunningTime="2026-07-18 02:40:26.006516879 +0000 UTC m=+22.658568580"
Jul 18 02:40:26.023027 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.022965    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8xm9b" podStartSLOduration=8.969396755 podStartE2EDuration="23.022951577s" totalImagesPullingTime="14.053554822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:26.022833126 +0000 UTC m=+22.674884826" watchObservedRunningTime="2026-07-18 02:40:26.022951577 +0000 UTC m=+22.675003278"
Jul 18 02:40:26.039183 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.039143    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wc75q" podStartSLOduration=4.36083692 podStartE2EDuration="23.039128714s" totalImagesPullingTime="18.678291794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:26.039014259 +0000 UTC m=+22.691065950" watchObservedRunningTime="2026-07-18 02:40:26.039128714 +0000 UTC m=+22.691180415"
Jul 18 02:40:26.153304 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.153271    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:26.228908 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.228824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:26.962851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.962812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2rrt" event={"ID":"da5aa183-5dc0-482a-b829-8eca8ba324f9","Type":"ContainerStarted","Data":"03dae2add787af635da7c712abc68a8fc8674a96a39a441c1dbbe42c26b5bc10"}
Jul 18 02:40:26.965414 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.965396    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:40:26.965701 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.965671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"b3cf70446a4c57dbe8199a91520f8a7e7fde916c5e5ec00a69eca479ab1bd281"}
Jul 18 02:40:26.965797 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.965752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"d04f7813328b5d300e17b011ff23bcc5863dbefcecd9df39f2f551d4d5df78b7"}
Jul 18 02:40:26.965861 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.965799    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"675c16381ab94d581ebb40e1e37648f5c386d1b17587213cd769e7a7019661e1"}
Jul 18 02:40:26.977273 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:26.977219    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g2rrt" podStartSLOduration=5.296615465 podStartE2EDuration="23.977174241s" totalImagesPullingTime="18.680558776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:26.976094399 +0000 UTC m=+23.628146099" watchObservedRunningTime="2026-07-18 02:40:26.977174241 +0000 UTC m=+23.629225934"
Jul 18 02:40:27.046453 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.046423    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:27.047037 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.047016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:27.067063 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.067028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:27.131540 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.131517    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 02:40:27.132781 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.132758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:27.740048 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.739932    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T02:40:27.131538496Z","UUID":"2bd879f7-4a30-47ba-8624-4e0034b9e25d","Handler":null,"Name":"","Endpoint":""}
Jul 18 02:40:27.741472 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.741445    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 02:40:27.741605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.741480    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 02:40:27.768027 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.767975    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:27.768197 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.768000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:27.768197 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.768108    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:27.768197 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:27.768115    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:27.768197 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:27.768189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:27.768391 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:27.768293    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:27.969662 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:27.969627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2" event={"ID":"75cecb39-6eea-4bf8-9869-864824d55ea4","Type":"ContainerStarted","Data":"37f5b2c996dda076a433e52174ebbd992172140da06136008d8775cb2f245e1f"}
Jul 18 02:40:28.973474 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:28.973438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2" event={"ID":"75cecb39-6eea-4bf8-9869-864824d55ea4","Type":"ContainerStarted","Data":"e25b3c9685de285e4ca24be7125ee301cd0158d9f62f17e75b07502811c2c31b"}
Jul 18 02:40:28.976836 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:28.976807    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:40:28.977412 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:28.977396    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 02:40:28.978058 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:28.978034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"59ba4551893c9df0da03391bd8fa9c7345a10582d9b882a7d4d74d0a5f264588"}
Jul 18 02:40:28.992585 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:28.992530    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wptv2" podStartSLOduration=5.083512607 podStartE2EDuration="25.992513424s" totalImagesPullingTime="20.909000817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:28.992091946 +0000 UTC m=+25.644143647" watchObservedRunningTime="2026-07-18 02:40:28.992513424 +0000 UTC m=+25.644565125"
Jul 18 02:40:29.777480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:29.777283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:29.777644 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:29.777345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:29.777644 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:29.777552    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:29.777733 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:29.777651    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:29.777733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:29.777349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:29.777733 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:29.777729    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:30.957960 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.957878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:30.983448 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.983272    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="82f165aa1ecde2ff8c5ff1fdce960a3f3df9a56ceb3ac789ce4437528f86915c" exitCode=0
Jul 18 02:40:30.983673 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.983357    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"82f165aa1ecde2ff8c5ff1fdce960a3f3df9a56ceb3ac789ce4437528f86915c"}
Jul 18 02:40:30.987059 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.987042    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:40:30.987381 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.987365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"78e807eb11ba0effd9f59d930b462c87138acc5a5401ccaa40acff263173f5e4"}
Jul 18 02:40:30.987646 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.987620    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:30.987787 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:30.987775    2567 scope.go:117] "RemoveContainer" containerID="229cd24609caee6b8a9b00ad918b0f098331976f539dfb7e62bf97ad037f4968"
Jul 18 02:40:31.004541 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.004516    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:31.019300 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.019274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:31.074456 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.074425    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:31.768471 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.768450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:31.768568 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.768478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:31.768568 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.768456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:31.768665 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:31.768589    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:31.768718 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:31.768690    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:31.768771 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:31.768756    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:31.993172 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.993078    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="c8fc443bc03e52865923946f0f44ee2e72d85f71f1dd5db064458aa0345db8ce" exitCode=0
Jul 18 02:40:31.993578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:31.993191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"c8fc443bc03e52865923946f0f44ee2e72d85f71f1dd5db064458aa0345db8ce"}
Jul 18 02:40:32.002133 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.002110    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:40:32.002587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.002554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" event={"ID":"7bc225be-fc5d-4a8e-8810-c49a78886682","Type":"ContainerStarted","Data":"8e7eb455f6df313057f622f78cb811449968e0a03e4d4c023d8c4bbe4d2ebe95"}
Jul 18 02:40:32.002834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.002810    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:32.002911 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.002874    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:32.006181 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.006160    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:32.020449 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.020424    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:40:32.045659 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.045608    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88" podStartSLOduration=10.279299541 podStartE2EDuration="29.0455929s" totalImagesPullingTime="18.766293359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:32.045065188 +0000 UTC m=+28.697116891" watchObservedRunningTime="2026-07-18 02:40:32.0455929 +0000 UTC m=+28.697644600"
Jul 18 02:40:32.073972 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.073938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:32.803978 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.803948    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:32.804450 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.804397    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 02:40:32.804655 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.804634    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8xm9b"
Jul 18 02:40:32.867963 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.867932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:32.913710 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.913681    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w5bm"]
Jul 18 02:40:32.913863 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.913836    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:32.913947 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:32.913929    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:32.914437 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.914415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pzv7t"]
Jul 18 02:40:32.914536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.914514    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:32.914629 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:32.914609    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:32.915124 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.915106    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jstt2"]
Jul 18 02:40:32.915223 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:32.915210    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:32.915334 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:32.915315    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:33.007456 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:33.007420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerStarted","Data":"b13861eb71a47c0dfa99d3b42d52f9ed7182e32bd2142208d6a4b2dbc11ea369"}
Jul 18 02:40:33.873437 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:33.873244    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:33.975062 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:33.975033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:34.011758 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:34.011730    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="b13861eb71a47c0dfa99d3b42d52f9ed7182e32bd2142208d6a4b2dbc11ea369" exitCode=0
Jul 18 02:40:34.012111 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:34.011816    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"b13861eb71a47c0dfa99d3b42d52f9ed7182e32bd2142208d6a4b2dbc11ea369"}
Jul 18 02:40:34.768158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:34.768079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:34.768303 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:34.768079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:34.768303 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:34.768202    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:34.768303 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:34.768079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:34.768454 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:34.768301    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:34.768454 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:34.768322    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:36.768095 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:36.768060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:36.768535 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:36.768060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:36.768535 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:36.768166    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:36.768535 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:36.768060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:36.768535 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:36.768241    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:36.768535 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:36.768307    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:37.311868 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:37.311838    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:37.364378 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:37.364344    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:37.433417 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:37.433386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:37.433579 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.433525    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:37.433644 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.433597    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret podName:876d7772-11d2-41b6-89a0-aa42c6bd9e0a nodeName:}" failed. No retries permitted until 2026-07-18 02:41:09.43357751 +0000 UTC m=+66.085629189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret") pod "global-pull-secret-syncer-pzv7t" (UID: "876d7772-11d2-41b6-89a0-aa42c6bd9e0a") : object "kube-system"/"original-pull-secret" not registered
Jul 18 02:40:37.534442 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:37.534408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:37.534650 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.534580    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:37.534708 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.534659    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs podName:2df05729-ccdd-45b2-b326-38cbe1d50f6d nodeName:}" failed. No retries permitted until 2026-07-18 02:41:09.534638192 +0000 UTC m=+66.186689887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs") pod "network-metrics-daemon-jstt2" (UID: "2df05729-ccdd-45b2-b326-38cbe1d50f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 02:40:37.635439 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:37.635402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:37.635667 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.635597    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 02:40:37.635667 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.635627    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 02:40:37.635667 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.635642    2567 projected.go:196] Error preparing data for projected volume kube-api-access-kpxzq for pod openshift-network-diagnostics/network-check-target-2w5bm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:37.635825 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:37.635712    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq podName:af34ebb0-74bf-4066-8b59-f0f6c0f8101a nodeName:}" failed. No retries permitted until 2026-07-18 02:41:09.635690718 +0000 UTC m=+66.287742414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpxzq" (UniqueName: "kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq") pod "network-check-target-2w5bm" (UID: "af34ebb0-74bf-4066-8b59-f0f6c0f8101a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 02:40:38.767934 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:38.767904    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:38.768562 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:38.768045    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jstt2" podUID="2df05729-ccdd-45b2-b326-38cbe1d50f6d"
Jul 18 02:40:38.768562 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:38.768047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:38.768562 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:38.768113    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzv7t" podUID="876d7772-11d2-41b6-89a0-aa42c6bd9e0a"
Jul 18 02:40:38.768562 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:38.768052    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:38.768562 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:38.768170    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w5bm" podUID="af34ebb0-74bf-4066-8b59-f0f6c0f8101a"
Jul 18 02:40:39.140460 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.140428    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeReady"
Jul 18 02:40:39.140617 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.140575    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 02:40:39.173411 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.173379    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:40:39.186487 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.186460    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lvfnm"]
Jul 18 02:40:39.186628 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.186579    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.188726 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.188697    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 02:40:39.188862 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.188762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 02:40:39.188919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.188907    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gcbm\""
Jul 18 02:40:39.188961 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.188946    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 02:40:39.198312 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.198110    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 02:40:39.202135 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.202113    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wjn5v"]
Jul 18 02:40:39.202243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.202226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.204712 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.204696    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pjzzd\""
Jul 18 02:40:39.204817 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.204712    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 02:40:39.204817 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.204724    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 02:40:39.204817 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.204776    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 02:40:39.218521 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.218489    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:40:39.218654 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.218528    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lvfnm"]
Jul 18 02:40:39.218654 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.218546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wjn5v"]
Jul 18 02:40:39.218654 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.218608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.221105 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.221087    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 02:40:39.221213 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.221112    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4pdzm\""
Jul 18 02:40:39.221213 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.221146    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 02:40:39.307425 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.307387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:39.350945 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.350912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351094 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.350956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351094 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrt4n\" (UniqueName: \"kubernetes.io/projected/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-kube-api-access-nrt4n\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.351094 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5l56\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-cert\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.351248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-tmp-dir\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.351418 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351418 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-config-volume\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.351485 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.351485 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351441    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8q6f\" (UniqueName: \"kubernetes.io/projected/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-kube-api-access-b8q6f\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.351485 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.351626 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.351483    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.397928 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.397906    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:39.452270 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452379 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8q6f\" (UniqueName: \"kubernetes.io/projected/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-kube-api-access-b8q6f\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.452379 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452308    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.452379 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452379 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrt4n\" (UniqueName: \"kubernetes.io/projected/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-kube-api-access-nrt4n\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.452425    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5l56\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.452474    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls podName:81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:39.952457954 +0000 UTC m=+36.604509637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls") pod "dns-default-wjn5v" (UID: "81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6") : secret "dns-default-metrics-tls" not found
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-cert\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452528    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.452578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-tmp-dir\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.453015 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.453015 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.452638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-config-volume\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.453129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.453035    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.453296 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.453276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.453374 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.453360    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 02:40:39.453429 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.453375    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b784fbb8-zxmnz: secret "image-registry-tls" not found
Jul 18 02:40:39.453429 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.453414    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls podName:cf2f7846-9553-426c-b0c3-91867a47db55 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:39.953400315 +0000 UTC m=+36.605452009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls") pod "image-registry-65b784fbb8-zxmnz" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55") : secret "image-registry-tls" not found
Jul 18 02:40:39.453429 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.453357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-tmp-dir\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.453580 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.453513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-config-volume\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.454075 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.454052    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.456907 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.456885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.456907 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.456899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-cert\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.457061 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.456938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.460426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.460406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5l56\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.460658 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.460635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8q6f\" (UniqueName: \"kubernetes.io/projected/ecb5e8ec-0a6a-4a53-9ceb-0266de781b38-kube-api-access-b8q6f\") pod \"ingress-canary-lvfnm\" (UID: \"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38\") " pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.461142 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.461127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrt4n\" (UniqueName: \"kubernetes.io/projected/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-kube-api-access-nrt4n\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.462028 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.462010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.511318 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.511285    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lvfnm"
Jul 18 02:40:39.705514 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.705335    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lvfnm"]
Jul 18 02:40:39.708672 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:39.708636    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb5e8ec_0a6a_4a53_9ceb_0266de781b38.slice/crio-35162a72cffbc13504b2fabfe0db0a3156a012dd684aeab197493e6dc7b39f6e WatchSource:0}: Error finding container 35162a72cffbc13504b2fabfe0db0a3156a012dd684aeab197493e6dc7b39f6e: Status 404 returned error can't find the container with id 35162a72cffbc13504b2fabfe0db0a3156a012dd684aeab197493e6dc7b39f6e
Jul 18 02:40:39.955745 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.955709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:39.955745 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:39.955756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:39.956330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.955866    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 02:40:39.956330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.955884    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b784fbb8-zxmnz: secret "image-registry-tls" not found
Jul 18 02:40:39.956330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.955910    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 02:40:39.956330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.955933    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls podName:cf2f7846-9553-426c-b0c3-91867a47db55 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:40.955918081 +0000 UTC m=+37.607969760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls") pod "image-registry-65b784fbb8-zxmnz" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55") : secret "image-registry-tls" not found
Jul 18 02:40:39.956330 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:39.955948    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls podName:81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:40.955938474 +0000 UTC m=+37.607990153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls") pod "dns-default-wjn5v" (UID: "81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6") : secret "dns-default-metrics-tls" not found
Jul 18 02:40:40.028196 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.028163    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="40c4941f3e17ceca7e3ca8ada854d46fa1f223e05eacf40058674c2554893694" exitCode=0
Jul 18 02:40:40.028368 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.028240    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"40c4941f3e17ceca7e3ca8ada854d46fa1f223e05eacf40058674c2554893694"}
Jul 18 02:40:40.029311 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.029276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lvfnm" event={"ID":"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38","Type":"ContainerStarted","Data":"35162a72cffbc13504b2fabfe0db0a3156a012dd684aeab197493e6dc7b39f6e"}
Jul 18 02:40:40.462677 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.462593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:40.531629 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.531597    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:40.640779 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.640743    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vdhgd"]
Jul 18 02:40:40.661486 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.661448    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vdhgd"]
Jul 18 02:40:40.661658 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.661584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.664555 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.664035    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 02:40:40.664555 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.664225    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 02:40:40.664555 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.664255    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 02:40:40.664555 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.664461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 02:40:40.664810 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.664632    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8nv5k\""
Jul 18 02:40:40.689880 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.689853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:40.748714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.748629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:40.762470 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.762440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-data-volume\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.762660 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.762482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.762660 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.762516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-crio-socket\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.762660 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.762564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.762660 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.762641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkm55\" (UniqueName: \"kubernetes.io/projected/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-api-access-lkm55\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.768494 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.768466    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:40:40.768494 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.768489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:40:40.768704 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.768480    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771406    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771436    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zt6zk\""
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771437    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hzcn2\""
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771437    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 02:40:40.771598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.771527    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 02:40:40.863904 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.863870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-data-volume\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.863904 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.863913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864169 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.864044    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:40.864169 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.864085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-crio-socket\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864169 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.864126    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:41.364102524 +0000 UTC m=+38.016154204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:40.864169 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.864155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864457 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.864215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkm55\" (UniqueName: \"kubernetes.io/projected/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-api-access-lkm55\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864457 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.864272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-data-volume\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864457 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.864272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-crio-socket\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.864457 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.864335    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 02:40:40.864457 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.864392    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:41.364377115 +0000 UTC m=+38.016428794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : configmap "kube-rbac-proxy" not found
Jul 18 02:40:40.873870 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.873847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkm55\" (UniqueName: \"kubernetes.io/projected/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-api-access-lkm55\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:40.965729 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.965699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:40.966167 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:40.965755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:40.966167 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.966044    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 02:40:40.966167 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.966068    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b784fbb8-zxmnz: secret "image-registry-tls" not found
Jul 18 02:40:40.966167 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.966153    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 02:40:40.966333 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.966156    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls podName:cf2f7846-9553-426c-b0c3-91867a47db55 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:42.966133814 +0000 UTC m=+39.618185493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls") pod "image-registry-65b784fbb8-zxmnz" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55") : secret "image-registry-tls" not found
Jul 18 02:40:40.966333 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:40.966215    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls podName:81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:42.966199391 +0000 UTC m=+39.618251076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls") pod "dns-default-wjn5v" (UID: "81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6") : secret "dns-default-metrics-tls" not found
Jul 18 02:40:41.023536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.023460    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:41.035238 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.035205    2567 generic.go:356] "Generic (PLEG): container finished" podID="bd042130-da2c-4cc3-a783-d1e8cf320610" containerID="46cd1544cfe835090b1e6d6882caa2315265996604da3661288d1152c7d509ab" exitCode=0
Jul 18 02:40:41.035404 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.035277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerDied","Data":"46cd1544cfe835090b1e6d6882caa2315265996604da3661288d1152c7d509ab"}
Jul 18 02:40:41.078271 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.078232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:41.369959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.369718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:41.370182 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:41.369840    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 02:40:41.370182 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:41.370114    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:42.370097559 +0000 UTC m=+39.022149243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : configmap "kube-rbac-proxy" not found
Jul 18 02:40:41.370182 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.370173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:41.370492 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:41.370303    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:41.370492 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:41.370345    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:42.370331693 +0000 UTC m=+39.022383380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:41.458682 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.458652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:41.560582 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.560545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:41.745272 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.745192    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:41.845532 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:41.845500    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:42.020592 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.020503    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"]
Jul 18 02:40:42.042859 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.042830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbs54" event={"ID":"bd042130-da2c-4cc3-a783-d1e8cf320610","Type":"ContainerStarted","Data":"d599a67e0a3c4df16b94caa276fd3de0a0585a6c4577cb92c40d8efc2c0b258a"}
Jul 18 02:40:42.043059 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.042871    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"]
Jul 18 02:40:42.043059 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.042956    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"
Jul 18 02:40:42.049611 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.046431    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x25sb\""
Jul 18 02:40:42.049611 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.046920    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 02:40:42.049611 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.047233    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 02:40:42.060916 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.060887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:42.069057 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.068997    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sbs54" podStartSLOduration=8.681403503 podStartE2EDuration="39.068959313s" totalImagesPullingTime="30.38755581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:42.066797816 +0000 UTC m=+38.718849517" watchObservedRunningTime="2026-07-18 02:40:42.068959313 +0000 UTC m=+38.721011015"
Jul 18 02:40:42.160942 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.160905    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:42.176390 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.175971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m287p\" (UniqueName: \"kubernetes.io/projected/2ddfb342-c8e2-41e0-9384-828c2ffe89ef-kube-api-access-m287p\") pod \"migrator-7cc9c7ffd7-krxjb\" (UID: \"2ddfb342-c8e2-41e0-9384-828c2ffe89ef\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"
Jul 18 02:40:42.250975 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.250950    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-thfh5_45dbdde2-9cdb-41ba-8f14-f38fd703c3e0/dns-node-resolver/0.log"
Jul 18 02:40:42.260785 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.260736    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:42.276970 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.276888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m287p\" (UniqueName: \"kubernetes.io/projected/2ddfb342-c8e2-41e0-9384-828c2ffe89ef-kube-api-access-m287p\") pod \"migrator-7cc9c7ffd7-krxjb\" (UID: \"2ddfb342-c8e2-41e0-9384-828c2ffe89ef\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"
Jul 18 02:40:42.287011 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.286959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m287p\" (UniqueName: \"kubernetes.io/projected/2ddfb342-c8e2-41e0-9384-828c2ffe89ef-kube-api-access-m287p\") pod \"migrator-7cc9c7ffd7-krxjb\" (UID: \"2ddfb342-c8e2-41e0-9384-828c2ffe89ef\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"
Jul 18 02:40:42.355529 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.355494    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"
Jul 18 02:40:42.377700 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.377678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:42.377766 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.377713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:42.377827 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.377798    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 02:40:42.377875 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.377845    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:44.37783153 +0000 UTC m=+41.029883209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : configmap "kube-rbac-proxy" not found
Jul 18 02:40:42.377875 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.377850    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:42.378001 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.377911    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:44.377892988 +0000 UTC m=+41.029944673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:42.497595 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.497522    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb"]
Jul 18 02:40:42.499925 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:42.499894    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddfb342_c8e2_41e0_9384_828c2ffe89ef.slice/crio-4e20c01e7885ed6993bd987322c2948ca13db1be556c956f41d68987359bf586 WatchSource:0}: Error finding container 4e20c01e7885ed6993bd987322c2948ca13db1be556c956f41d68987359bf586: Status 404 returned error can't find the container with id 4e20c01e7885ed6993bd987322c2948ca13db1be556c956f41d68987359bf586
Jul 18 02:40:42.982645 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.982546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:42.982645 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:42.982589    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:42.982861 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.982690    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 02:40:42.982861 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.982696    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 02:40:42.982861 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.982712    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b784fbb8-zxmnz: secret "image-registry-tls" not found
Jul 18 02:40:42.982861 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.982747    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls podName:81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:46.982730725 +0000 UTC m=+43.634782424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls") pod "dns-default-wjn5v" (UID: "81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6") : secret "dns-default-metrics-tls" not found
Jul 18 02:40:42.982861 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:42.982761    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls podName:cf2f7846-9553-426c-b0c3-91867a47db55 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:46.982755074 +0000 UTC m=+43.634806753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls") pod "image-registry-65b784fbb8-zxmnz" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55") : secret "image-registry-tls" not found
Jul 18 02:40:43.045684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.045650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb" event={"ID":"2ddfb342-c8e2-41e0-9384-828c2ffe89ef","Type":"ContainerStarted","Data":"4e20c01e7885ed6993bd987322c2948ca13db1be556c956f41d68987359bf586"}
Jul 18 02:40:43.047364 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.047164    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lvfnm" event={"ID":"ecb5e8ec-0a6a-4a53-9ceb-0266de781b38","Type":"ContainerStarted","Data":"1e7cf00076b47bc350116c32b528ff5e6f4a2edead5a90f667af3e7dc22150ae"}
Jul 18 02:40:43.065635 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.065587    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lvfnm" podStartSLOduration=1.148367022 podStartE2EDuration="4.065574191s" totalImagesPullingTime="2.917207169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:43.065074378 +0000 UTC m=+39.717126100" watchObservedRunningTime="2026-07-18 02:40:43.065574191 +0000 UTC m=+39.717625891"
Jul 18 02:40:43.156427 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.156395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:43.212547 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.212515    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:43.249314 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.249234    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82k4d_20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b/node-ca/0.log"
Jul 18 02:40:43.397220 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.397188    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:43.453345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.453292    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:43.850631 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.850597    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lvfnm_ecb5e8ec-0a6a-4a53-9ceb-0266de781b38/serve-healthcheck-canary/0.log"
Jul 18 02:40:43.953959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:43.953923    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:44.054633 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:44.054603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:44.267932 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:44.267891    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:44.393177 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:44.393152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:44.393296 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:44.393193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:44.393343 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:44.393293    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:44.393343 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:44.393312    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 02:40:44.393397 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:44.393358    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:48.393339217 +0000 UTC m=+45.045390896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:44.393397 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:44.393371    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:48.39336572 +0000 UTC m=+45.045417398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : configmap "kube-rbac-proxy" not found
Jul 18 02:40:45.053354 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:45.053310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb" event={"ID":"2ddfb342-c8e2-41e0-9384-828c2ffe89ef","Type":"ContainerStarted","Data":"da1bd3918afe2b81a4a24306b21af7dc8a489f0905136103f34d85932d01ee56"}
Jul 18 02:40:45.053619 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:45.053419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb" event={"ID":"2ddfb342-c8e2-41e0-9384-828c2ffe89ef","Type":"ContainerStarted","Data":"51a3d4023f07f4840896bf5d6c3b5dcaed94496c84c356e90263f645f94dde93"}
Jul 18 02:40:45.071417 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:45.071366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krxjb" podStartSLOduration=1.186626898 podStartE2EDuration="3.071347307s" totalImagesPullingTime="1.884720409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:45.070553104 +0000 UTC m=+41.722604831" watchObservedRunningTime="2026-07-18 02:40:45.071347307 +0000 UTC m=+41.723398985"
Jul 18 02:40:47.017173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:47.017136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:47.017173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:47.017180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:47.017612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:47.017288    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 02:40:47.017612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:47.017307    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b784fbb8-zxmnz: secret "image-registry-tls" not found
Jul 18 02:40:47.017612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:47.017335    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 02:40:47.017612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:47.017365    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls podName:cf2f7846-9553-426c-b0c3-91867a47db55 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:55.017351821 +0000 UTC m=+51.669403518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls") pod "image-registry-65b784fbb8-zxmnz" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55") : secret "image-registry-tls" not found
Jul 18 02:40:47.017612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:47.017383    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls podName:81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:55.017372258 +0000 UTC m=+51.669423937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls") pod "dns-default-wjn5v" (UID: "81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6") : secret "dns-default-metrics-tls" not found
Jul 18 02:40:48.072605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.072577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:48.360187 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.360158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:48.426366 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.426334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:48.426509 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.426386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:48.426509 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:48.426479    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:48.426612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:48.426535    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 02:40:48.426612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:48.426540    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:56.426525421 +0000 UTC m=+53.078577100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:48.426612 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:48.426595    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:40:56.42658262 +0000 UTC m=+53.078634299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : configmap "kube-rbac-proxy" not found
Jul 18 02:40:48.461860 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.461822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:48.942747 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:48.942713    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:49.195280 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:49.195198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:49.318782 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:49.318752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:49.401696 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:49.401668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:49.844325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:49.844295    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:50.642469 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:50.642438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:50.849733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:50.849480    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:51.244850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:51.244809    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:51.441939 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:51.441906    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:52.045931 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:52.045897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:52.441976 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:52.441946    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:52.647092 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:52.647059    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:52.847198 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:52.847121    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.066596 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.066560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.250458 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.250427    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.662959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.662931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.762806 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.762775    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.863553 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.863522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:53.918913 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:53.918835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:54.446455 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:54.446419    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:54.844559 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:54.844481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:55.078716 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.078680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:55.078887 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.078733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:55.081999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.081957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6-metrics-tls\") pod \"dns-default-wjn5v\" (UID: \"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6\") " pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:55.082111 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.081961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"image-registry-65b784fbb8-zxmnz\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") " pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:55.101917 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.101848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:55.126834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.126582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:55.241481 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.241445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:55.266508 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.266476    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:40:55.279761 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.279734    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wjn5v"]
Jul 18 02:40:55.282473 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:40:55.282450    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81aecfa1_abc8_4c71_9eaf_3e735ec5f8d6.slice/crio-586ec62786d2e5224b9422550b11ede38b7ca0b9c2ef17ed6251fd3a584910e1 WatchSource:0}: Error finding container 586ec62786d2e5224b9422550b11ede38b7ca0b9c2ef17ed6251fd3a584910e1: Status 404 returned error can't find the container with id 586ec62786d2e5224b9422550b11ede38b7ca0b9c2ef17ed6251fd3a584910e1
Jul 18 02:40:55.387777 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.387753    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:55.512562 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.512530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:55.842749 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:55.842670    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:56.078831 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.078781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjn5v" event={"ID":"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6","Type":"ContainerStarted","Data":"586ec62786d2e5224b9422550b11ede38b7ca0b9c2ef17ed6251fd3a584910e1"}
Jul 18 02:40:56.080614 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.080588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" event={"ID":"cf2f7846-9553-426c-b0c3-91867a47db55","Type":"ContainerStarted","Data":"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"}
Jul 18 02:40:56.080741 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.080631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" event={"ID":"cf2f7846-9553-426c-b0c3-91867a47db55","Type":"ContainerStarted","Data":"de7ad4696639c284d5f715600fed90a31f0815ed95da4af4d693e5156cc3b5c7"}
Jul 18 02:40:56.080875 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.080855    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:40:56.102932 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.102832    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" podStartSLOduration=23.102811789 podStartE2EDuration="23.102811789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:56.102665409 +0000 UTC m=+52.754717107" watchObservedRunningTime="2026-07-18 02:40:56.102811789 +0000 UTC m=+52.754863470"
Jul 18 02:40:56.126341 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.126306    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:56.446965 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.446929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:56.488156 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.488118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:56.488343 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.488166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:56.488343 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:56.488285    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:56.488463 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:40:56.488352    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls podName:6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7 nodeName:}" failed. No retries permitted until 2026-07-18 02:41:12.48833414 +0000 UTC m=+69.140385822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vdhgd" (UID: "6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7") : secret "insights-runtime-extractor-tls" not found
Jul 18 02:40:56.488784 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:56.488761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:40:57.047663 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:57.047620    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:57.244672 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:57.244632    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:57.642184 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:57.642149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:57.844337 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:57.844316    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:58.092378 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.092345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjn5v" event={"ID":"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6","Type":"ContainerStarted","Data":"55beea6d2182dde215885c7bde2d047cd044c36d9ea77b33e48d01865ff49733"}
Jul 18 02:40:58.092872 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.092432    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjn5v" event={"ID":"81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6","Type":"ContainerStarted","Data":"7e13ece8f3fb77e8d5727d0d0fd2267ce4df0fd19a7ff1efa3cb26d66a985068"}
Jul 18 02:40:58.092872 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.092462    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:40:58.109966 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.109910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wjn5v" podStartSLOduration=16.630413971 podStartE2EDuration="19.109895678s" totalImagesPullingTime="2.479481707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:40:58.109361917 +0000 UTC m=+54.761413618" watchObservedRunningTime="2026-07-18 02:40:58.109895678 +0000 UTC m=+54.761947378"
Jul 18 02:40:58.242022 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.241920    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:58.742724 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.742688    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:58.840892 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.840857    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:58.941961 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:58.941931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.042195 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.042121    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.216476 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.216447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.317385 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.317309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.452053 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.452028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.615317 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.615291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.716688 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.716663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.825711 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.825682    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:40:59.886601 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:40:59.886523    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:00.431248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:00.431219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:00.629952 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:00.629923    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:00.766737 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:00.766656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:00.866896 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:00.866864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:01.441066 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:01.441031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:01.500255 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:01.500225    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:04.023063 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:04.023037    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7r88"
Jul 18 02:41:05.840647 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:05.840621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:07.220431 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.220393    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:41:07.307714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.307679    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:07.339782 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.339749    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-bntwv"]
Jul 18 02:41:07.343678 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.343662    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:07.346594 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.346570    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 02:41:07.346594 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.346585    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 02:41:07.346879 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.346865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-phmv8\""
Jul 18 02:41:07.354569 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.354545    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bntwv"]
Jul 18 02:41:07.370069 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.370039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlpt\" (UniqueName: \"kubernetes.io/projected/47c69a13-f6e6-452b-b87d-b34c40b564ce-kube-api-access-5hlpt\") pod \"downloads-5bc67dcd46-bntwv\" (UID: \"47c69a13-f6e6-452b-b87d-b34c40b564ce\") " pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:07.405890 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.405863    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:07.470792 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.470708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlpt\" (UniqueName: \"kubernetes.io/projected/47c69a13-f6e6-452b-b87d-b34c40b564ce-kube-api-access-5hlpt\") pod \"downloads-5bc67dcd46-bntwv\" (UID: \"47c69a13-f6e6-452b-b87d-b34c40b564ce\") " pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:07.485582 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.485549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlpt\" (UniqueName: \"kubernetes.io/projected/47c69a13-f6e6-452b-b87d-b34c40b564ce-kube-api-access-5hlpt\") pod \"downloads-5bc67dcd46-bntwv\" (UID: \"47c69a13-f6e6-452b-b87d-b34c40b564ce\") " pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:07.506284 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.506246    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:07.605590 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.605560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:07.651885 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.651859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:07.774861 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:07.774830    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bntwv"]
Jul 18 02:41:07.778454 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:07.778429    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c69a13_f6e6_452b_b87d_b34c40b564ce.slice/crio-905ab84344b990b1d1b2efc774b1702cd1f2a2d7af164f54799d295a2e171b75 WatchSource:0}: Error finding container 905ab84344b990b1d1b2efc774b1702cd1f2a2d7af164f54799d295a2e171b75: Status 404 returned error can't find the container with id 905ab84344b990b1d1b2efc774b1702cd1f2a2d7af164f54799d295a2e171b75
Jul 18 02:41:08.098965 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.098892    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wjn5v"
Jul 18 02:41:08.128196 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.128161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bntwv" event={"ID":"47c69a13-f6e6-452b-b87d-b34c40b564ce","Type":"ContainerStarted","Data":"905ab84344b990b1d1b2efc774b1702cd1f2a2d7af164f54799d295a2e171b75"}
Jul 18 02:41:08.243581 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.243546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:08.302571 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.302533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:08.642236 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.642146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:08.699430 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:08.699400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.399671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.399634    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.485745 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.485703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:41:09.488508 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.488486    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 02:41:09.498271 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.498234    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.499937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.499903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/876d7772-11d2-41b6-89a0-aa42c6bd9e0a-original-pull-secret\") pod \"global-pull-secret-syncer-pzv7t\" (UID: \"876d7772-11d2-41b6-89a0-aa42c6bd9e0a\") " pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:41:09.534177 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.534144    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"]
Jul 18 02:41:09.559395 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.559361    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"]
Jul 18 02:41:09.559571 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.559497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:09.562239 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.562214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 18 02:41:09.562239 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.562230    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-87x6c\""
Jul 18 02:41:09.578851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.578819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.582159 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.582136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzv7t"
Jul 18 02:41:09.586532 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.586505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:41:09.589025 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.589005    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 02:41:09.599646 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.599613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2df05729-ccdd-45b2-b326-38cbe1d50f6d-metrics-certs\") pod \"network-metrics-daemon-jstt2\" (UID: \"2df05729-ccdd-45b2-b326-38cbe1d50f6d\") " pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:41:09.641492 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.641406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.687450 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.687409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9202b5c1-b436-4644-a399-7d58563cf023-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcrxp\" (UID: \"9202b5c1-b436-4644-a399-7d58563cf023\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:09.687648 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.687468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:41:09.690098 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.690071    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 02:41:09.701277 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.700339    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 02:41:09.712293 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.712267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxzq\" (UniqueName: \"kubernetes.io/projected/af34ebb0-74bf-4066-8b59-f0f6c0f8101a-kube-api-access-kpxzq\") pod \"network-check-target-2w5bm\" (UID: \"af34ebb0-74bf-4066-8b59-f0f6c0f8101a\") " pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:41:09.742718 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.742691    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:09.758174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.758135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pzv7t"]
Jul 18 02:41:09.762147 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:09.762115    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876d7772_11d2_41b6_89a0_aa42c6bd9e0a.slice/crio-57e85bedd5b68fb7e48a88556b62369b8e1327b0ae7b14644b9d128e039bc45b WatchSource:0}: Error finding container 57e85bedd5b68fb7e48a88556b62369b8e1327b0ae7b14644b9d128e039bc45b: Status 404 returned error can't find the container with id 57e85bedd5b68fb7e48a88556b62369b8e1327b0ae7b14644b9d128e039bc45b
Jul 18 02:41:09.788937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.788900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9202b5c1-b436-4644-a399-7d58563cf023-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcrxp\" (UID: \"9202b5c1-b436-4644-a399-7d58563cf023\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:09.791933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.791904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9202b5c1-b436-4644-a399-7d58563cf023-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcrxp\" (UID: \"9202b5c1-b436-4644-a399-7d58563cf023\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:09.870266 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.870229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:09.891998 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.891955    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zt6zk\""
Jul 18 02:41:09.897222 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.897195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hzcn2\""
Jul 18 02:41:09.900469 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.900452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:41:09.904199 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:09.904178    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jstt2"
Jul 18 02:41:10.038720 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.038677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:10.060580 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.060546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"]
Jul 18 02:41:10.081955 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.081926    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w5bm"]
Jul 18 02:41:10.086409 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:10.086386    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf34ebb0_74bf_4066_8b59_f0f6c0f8101a.slice/crio-bd216b627a8886cb370eed44151172184097576b415e50c72cc53a3c7108e800 WatchSource:0}: Error finding container bd216b627a8886cb370eed44151172184097576b415e50c72cc53a3c7108e800: Status 404 returned error can't find the container with id bd216b627a8886cb370eed44151172184097576b415e50c72cc53a3c7108e800
Jul 18 02:41:10.103704 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.103621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jstt2"]
Jul 18 02:41:10.106046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.106022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:10.106407 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:10.106383    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df05729_ccdd_45b2_b326_38cbe1d50f6d.slice/crio-a9bb736f184a0169689e8d849b68ffa70ee94ce97115e61d500ea7291dfe7cee WatchSource:0}: Error finding container a9bb736f184a0169689e8d849b68ffa70ee94ce97115e61d500ea7291dfe7cee: Status 404 returned error can't find the container with id a9bb736f184a0169689e8d849b68ffa70ee94ce97115e61d500ea7291dfe7cee
Jul 18 02:41:10.138598 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.138557    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp" event={"ID":"9202b5c1-b436-4644-a399-7d58563cf023","Type":"ContainerStarted","Data":"41c62d63239296f43c6b1f08d84ef0f2aeceba0b3458bff86b0aeb3a599b0274"}
Jul 18 02:41:10.140154 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.140122    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pzv7t" event={"ID":"876d7772-11d2-41b6-89a0-aa42c6bd9e0a","Type":"ContainerStarted","Data":"57e85bedd5b68fb7e48a88556b62369b8e1327b0ae7b14644b9d128e039bc45b"}
Jul 18 02:41:10.142246 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.142219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jstt2" event={"ID":"2df05729-ccdd-45b2-b326-38cbe1d50f6d","Type":"ContainerStarted","Data":"a9bb736f184a0169689e8d849b68ffa70ee94ce97115e61d500ea7291dfe7cee"}
Jul 18 02:41:10.143532 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:10.143501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w5bm" event={"ID":"af34ebb0-74bf-4066-8b59-f0f6c0f8101a","Type":"ContainerStarted","Data":"bd216b627a8886cb370eed44151172184097576b415e50c72cc53a3c7108e800"}
Jul 18 02:41:11.648365 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:11.648331    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:11.748373 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:11.748340    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:12.157781 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.157740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jstt2" event={"ID":"2df05729-ccdd-45b2-b326-38cbe1d50f6d","Type":"ContainerStarted","Data":"1562d0c51b701541257fe813e9b769cfedc5ee146792b786a825fc65966ab183"}
Jul 18 02:41:12.159471 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.159441    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp" event={"ID":"9202b5c1-b436-4644-a399-7d58563cf023","Type":"ContainerStarted","Data":"9bb1c4b8a786d55cdd8410581f509442909a3e610a441fc72245e3602d726756"}
Jul 18 02:41:12.160465 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.160400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:12.166294 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.166270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp"
Jul 18 02:41:12.176472 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.176413    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcrxp" podStartSLOduration=1.27639724 podStartE2EDuration="3.176398032s" totalImagesPullingTime="1.900000792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:12.175862967 +0000 UTC m=+68.827914669" watchObservedRunningTime="2026-07-18 02:41:12.176398032 +0000 UTC m=+68.828449710"
Jul 18 02:41:12.469367 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.469317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:12.518228 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.518190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:41:12.520956 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.520927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vdhgd\" (UID: \"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7\") " pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:41:12.571005 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.570924    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:12.635577 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.635539    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:12.742492 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.742362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:12.774772 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.774740    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8nv5k\""
Jul 18 02:41:12.783072 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:12.783044    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vdhgd"
Jul 18 02:41:13.169430 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.169391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jstt2" event={"ID":"2df05729-ccdd-45b2-b326-38cbe1d50f6d","Type":"ContainerStarted","Data":"096e0c5d85cdd1c3289136da162919fdb88c350f7b3fe776d519516b734d6eef"}
Jul 18 02:41:13.188362 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.187730    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jstt2" podStartSLOduration=68.329281301 podStartE2EDuration="1m10.187711888s" totalImagesPullingTime="1.858430587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:13.186737369 +0000 UTC m=+69.838789071" watchObservedRunningTime="2026-07-18 02:41:13.187711888 +0000 UTC m=+69.839763593"
Jul 18 02:41:13.309450 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.309336    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:13.362620 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.362549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:13.676700 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.676634    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:13.744976 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:13.744940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:14.565617 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:14.565578    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:15.662146 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:15.662080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:15.757732 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:15.757699    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:15.990062 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:15.990035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vdhgd"]
Jul 18 02:41:15.994886 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:15.994862    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc2b8e4_0718_4aa4_ab82_f64f7355aaf7.slice/crio-03b84baada0c074ef580be2cae8e62ddfb5769eff06f1f60c55aee34441e6246 WatchSource:0}: Error finding container 03b84baada0c074ef580be2cae8e62ddfb5769eff06f1f60c55aee34441e6246: Status 404 returned error can't find the container with id 03b84baada0c074ef580be2cae8e62ddfb5769eff06f1f60c55aee34441e6246
Jul 18 02:41:16.062601 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.062560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:16.167671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.167637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:16.180344 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.180214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pzv7t" event={"ID":"876d7772-11d2-41b6-89a0-aa42c6bd9e0a","Type":"ContainerStarted","Data":"2e4ce5e83b9ae492ca5eadfa95fd8941c4737bb83163228b80f05c914a7dac92"}
Jul 18 02:41:16.181782 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.181759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdhgd" event={"ID":"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7","Type":"ContainerStarted","Data":"03b84baada0c074ef580be2cae8e62ddfb5769eff06f1f60c55aee34441e6246"}
Jul 18 02:41:16.183796 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.183746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w5bm" event={"ID":"af34ebb0-74bf-4066-8b59-f0f6c0f8101a","Type":"ContainerStarted","Data":"da2d0843b765f38adc76c8609a36a41e5c074035848e07244f82efaaaee29a72"}
Jul 18 02:41:16.184019 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.183966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:41:16.196423 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.196367    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pzv7t" podStartSLOduration=67.116827555 podStartE2EDuration="1m13.19634978s" totalImagesPullingTime="6.079522225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:16.19633555 +0000 UTC m=+72.848387252" watchObservedRunningTime="2026-07-18 02:41:16.19634978 +0000 UTC m=+72.848401479"
Jul 18 02:41:16.217605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.217560    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2w5bm" podStartSLOduration=67.480938451 podStartE2EDuration="1m13.217544441s" totalImagesPullingTime="5.73660599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:16.216660949 +0000 UTC m=+72.868712652" watchObservedRunningTime="2026-07-18 02:41:16.217544441 +0000 UTC m=+72.869596186"
Jul 18 02:41:16.728132 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.728097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:16.959933 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.959869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:16.973999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.972758    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"]
Jul 18 02:41:16.975836 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.975811    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:16.978343 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.978242    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8ww8h\""
Jul 18 02:41:16.979835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.979031    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 18 02:41:16.979835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.979093    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 02:41:16.979835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.979296    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 02:41:16.979835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.979481    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 02:41:16.979835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.979655    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 18 02:41:16.993955 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:16.993931    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"]
Jul 18 02:41:17.000679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.000648    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"]
Jul 18 02:41:17.003942 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.003920    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.010805 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.009899    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 18 02:41:17.010805 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.010189    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lvbdg\""
Jul 18 02:41:17.010805 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.010444    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 18 02:41:17.010805 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.010593    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 18 02:41:17.022642 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.022563    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"]
Jul 18 02:41:17.023662 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.023643    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-29n7v"]
Jul 18 02:41:17.027436 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.027413    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.031059 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.031036    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 02:41:17.031312 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.031294    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 02:41:17.031558 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.031541    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 02:41:17.031767 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.031752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2x9df\""
Jul 18 02:41:17.059761 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad49cae8-eba7-40d1-bad5-7e484970f8cf-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwg4\" (UniqueName: \"kubernetes.io/projected/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-api-access-rmwg4\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmgs\" (UniqueName: \"kubernetes.io/projected/33243675-6aa1-43d9-85b2-59ee84ef8228-kube-api-access-bqmgs\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.059911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.060060 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.060039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.060311 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.060078    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.060311 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.060109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33243675-6aa1-43d9-85b2-59ee84ef8228-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.060311 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.060132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.073429 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.073400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161436    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-textfile\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad49cae8-eba7-40d1-bad5-7e484970f8cf-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-wtmp\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwg4\" (UniqueName: \"kubernetes.io/projected/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-api-access-rmwg4\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-metrics-client-ca\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmgs\" (UniqueName: \"kubernetes.io/projected/33243675-6aa1-43d9-85b2-59ee84ef8228-kube-api-access-bqmgs\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-root\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-accelerators-collector-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161770    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhc5\" (UniqueName: \"kubernetes.io/projected/b656138f-3754-4f7a-be3a-43f522e81e61-kube-api-access-fqhc5\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161791    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-tls\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.162999 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33243675-6aa1-43d9-85b2-59ee84ef8228-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.161976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.162020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-sys\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:41:17.162671    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:41:17.162738    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls podName:ad49cae8-eba7-40d1-bad5-7e484970f8cf nodeName:}" failed. No retries permitted until 2026-07-18 02:41:17.662716789 +0000 UTC m=+74.314768469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-7rpvl" (UID: "ad49cae8-eba7-40d1-bad5-7e484970f8cf") : secret "kube-state-metrics-tls" not found
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.162830    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad49cae8-eba7-40d1-bad5-7e484970f8cf-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:41:17.163182    2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:41:17.163270    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls podName:33243675-6aa1-43d9-85b2-59ee84ef8228 nodeName:}" failed. No retries permitted until 2026-07-18 02:41:17.663249019 +0000 UTC m=+74.315300733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-bwv8s" (UID: "33243675-6aa1-43d9-85b2-59ee84ef8228") : secret "openshift-state-metrics-tls" not found
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.163502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.164158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.163612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33243675-6aa1-43d9-85b2-59ee84ef8228-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.164739 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.164549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.165486 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.165461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.165696 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.165680    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.167256 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.167234    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.171818 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.171777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwg4\" (UniqueName: \"kubernetes.io/projected/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-api-access-rmwg4\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.173554 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.173492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmgs\" (UniqueName: \"kubernetes.io/projected/33243675-6aa1-43d9-85b2-59ee84ef8228-kube-api-access-bqmgs\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.230897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.230069    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:41:17.260207 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.260169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.263125 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263273 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-sys\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263273 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-textfile\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263379 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-sys\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263423 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-wtmp\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263465 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-metrics-client-ca\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263515 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-root\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263515 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-accelerators-collector-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263609 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-textfile\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263609 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhc5\" (UniqueName: \"kubernetes.io/projected/b656138f-3754-4f7a-be3a-43f522e81e61-kube-api-access-fqhc5\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263702 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263628    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-tls\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.263756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-wtmp\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.264078 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.263957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b656138f-3754-4f7a-be3a-43f522e81e61-root\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.265098 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.265073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-metrics-client-ca\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.265817 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.265761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-accelerators-collector-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.267846 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.267808    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.268721 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.268700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b656138f-3754-4f7a-be3a-43f522e81e61-node-exporter-tls\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.272514 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.272487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhc5\" (UniqueName: \"kubernetes.io/projected/b656138f-3754-4f7a-be3a-43f522e81e61-kube-api-access-fqhc5\") pod \"node-exporter-29n7v\" (UID: \"b656138f-3754-4f7a-be3a-43f522e81e61\") " pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.324830 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.324797    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.342836 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.342800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29n7v"
Jul 18 02:41:17.359578 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:17.359545    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb656138f_3754_4f7a_be3a_43f522e81e61.slice/crio-e4cd38a6f1c185fe5fff582df85fec84ba0324e01aed097e594c1942a28a91a1 WatchSource:0}: Error finding container e4cd38a6f1c185fe5fff582df85fec84ba0324e01aed097e594c1942a28a91a1: Status 404 returned error can't find the container with id e4cd38a6f1c185fe5fff582df85fec84ba0324e01aed097e594c1942a28a91a1
Jul 18 02:41:17.452809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.452772    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.606046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.606017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.667669 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.667484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.667669 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.667577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.670782 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.670756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad49cae8-eba7-40d1-bad5-7e484970f8cf-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7rpvl\" (UID: \"ad49cae8-eba7-40d1-bad5-7e484970f8cf\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.670923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.670761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33243675-6aa1-43d9-85b2-59ee84ef8228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bwv8s\" (UID: \"33243675-6aa1-43d9-85b2-59ee84ef8228\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.707371 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.707335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.807143 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.807109    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:17.889063 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.888753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"
Jul 18 02:41:17.919090 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.919046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"
Jul 18 02:41:17.966919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:17.966821    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:18.070537 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.070446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:18.082418 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.082339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s"]
Jul 18 02:41:18.087659 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:18.087613    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33243675_6aa1_43d9_85b2_59ee84ef8228.slice/crio-5a7813335a46e3b419420a23be4d7d5f0850af9f811448f286c645dc172ad523 WatchSource:0}: Error finding container 5a7813335a46e3b419420a23be4d7d5f0850af9f811448f286c645dc172ad523: Status 404 returned error can't find the container with id 5a7813335a46e3b419420a23be4d7d5f0850af9f811448f286c645dc172ad523
Jul 18 02:41:18.111239 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.109972    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7rpvl"]
Jul 18 02:41:18.163685 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.163620    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:18.194204 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.194179    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29n7v" event={"ID":"b656138f-3754-4f7a-be3a-43f522e81e61","Type":"ContainerStarted","Data":"e4cd38a6f1c185fe5fff582df85fec84ba0324e01aed097e594c1942a28a91a1"}
Jul 18 02:41:18.196352 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.196324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s" event={"ID":"33243675-6aa1-43d9-85b2-59ee84ef8228","Type":"ContainerStarted","Data":"dc6b4a1314aabb555372497b88c1cef730e31f7aa252c4ebbe84de006f229877"}
Jul 18 02:41:18.196462 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.196382    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s" event={"ID":"33243675-6aa1-43d9-85b2-59ee84ef8228","Type":"ContainerStarted","Data":"5a7813335a46e3b419420a23be4d7d5f0850af9f811448f286c645dc172ad523"}
Jul 18 02:41:18.198590 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.198565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl" event={"ID":"ad49cae8-eba7-40d1-bad5-7e484970f8cf","Type":"ContainerStarted","Data":"60aabf3d653da6f4fea6b03076ec8193ddf656902248128c70ccacd4d9175365"}
Jul 18 02:41:18.365028 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:18.364979    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:19.110489 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.108782    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"]
Jul 18 02:41:19.119007 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.117676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.121009 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.120302    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 02:41:19.121009 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.120614    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 02:41:19.121009 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.120867    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7fcms\""
Jul 18 02:41:19.123381 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.121337    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 02:41:19.123381 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.121585    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 02:41:19.123381 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.122240    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 02:41:19.123381 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.122314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cbcmpnurv9gk7\""
Jul 18 02:41:19.123742 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.123628    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"]
Jul 18 02:41:19.184182 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184346 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-grpc-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184346 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184346 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184254    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184346 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397579a0-0100-4ea0-80be-3320701cf482-metrics-client-ca\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184346 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184344    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184613 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.184613 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.184400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc2l7\" (UniqueName: \"kubernetes.io/projected/397579a0-0100-4ea0-80be-3320701cf482-kube-api-access-wc2l7\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.205483 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.205453    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s" event={"ID":"33243675-6aa1-43d9-85b2-59ee84ef8228","Type":"ContainerStarted","Data":"18f07ef8bb0ba1f528d1faeb30941db56f07f85f2f6b63ac94264a1ccb01b89d"}
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-grpc-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397579a0-0100-4ea0-80be-3320701cf482-metrics-client-ca\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285597    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc2l7\" (UniqueName: \"kubernetes.io/projected/397579a0-0100-4ea0-80be-3320701cf482-kube-api-access-wc2l7\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.285624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.287010 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.286790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397579a0-0100-4ea0-80be-3320701cf482-metrics-client-ca\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.292567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.292540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.294015 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.293521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.296654 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.296610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-grpc-tls\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.297348 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.297309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.297845 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.297796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.298514 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.298474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397579a0-0100-4ea0-80be-3320701cf482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.304306 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.304265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc2l7\" (UniqueName: \"kubernetes.io/projected/397579a0-0100-4ea0-80be-3320701cf482-kube-api-access-wc2l7\") pod \"thanos-querier-5994bbbbd5-jsb8l\" (UID: \"397579a0-0100-4ea0-80be-3320701cf482\") " pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.432803 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.432723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:19.933873 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:19.933844    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:20.033864 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:20.033833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:20.133368 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:20.133327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:20.191857 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:20.191776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:20.565550 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:20.565474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:21.542128 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:21.542087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:21.598566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:21.598536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:21.755593 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:21.755556    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:21.816784 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:21.816678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:22.627204 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:22.627138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:22.723707 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:22.723673    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:23.194781 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.194747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:41:23.199114 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.199085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.201804 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.201783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 02:41:23.201956 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.201790    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 02:41:23.202218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202051    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 02:41:23.202218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202117    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 02:41:23.202218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202135    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 02:41:23.202218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3reobe0ueue0d\""
Jul 18 02:41:23.202520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 02:41:23.202584 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202563    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 02:41:23.202584 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202563    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 02:41:23.202702 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202686    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 02:41:23.202939 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.202903    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 02:41:23.203070 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.203008    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 02:41:23.203070 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.203045    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 02:41:23.203185 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.203120    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bkmgg\""
Jul 18 02:41:23.203185 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.203145    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 02:41:23.203283 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.203248    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 02:41:23.207234 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.207208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:23.207393 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.207375    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 02:41:23.216513 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.216488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:41:23.322017 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.321969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322214 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322214 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322214 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322135    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322214 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322275    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j52js\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.322809 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.322644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423721 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423721 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423954 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423954 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423954 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423829    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.423954 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.423856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424145 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424145 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424145 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j52js\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424667 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424425    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424667 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.424771 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.424668    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.425679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.425308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.425679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.425390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.425679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.425635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.426250 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.426226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.427330 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.427276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.427495 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.427471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.428017 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.427935    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.428241 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.428146    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.429169 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.429147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430014 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.429969    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430130 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.430066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430130 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.430071    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430283 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.430257    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430597 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.430573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.430669 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.430580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.431755 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.431734    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.431936 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.431909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.435392 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.435372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j52js\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js\") pod \"prometheus-k8s-0\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:23.511394 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:23.511302    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:28.788230 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:28.788111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:28.843156 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:28.843111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:29.148848 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:29.148819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:29.319652 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:29.319618    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:29.378116 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:29.378043    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:30.294684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:30.294560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"]
Jul 18 02:41:30.349617 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:30.349522    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:41:30.351333 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:41:30.351281    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77c7769_bbd9_442e_9ec1_6579896f12f3.slice/crio-335cb9330efc0734ed7350fc9811a05cfa0ad017be7855dd10836ce1290f7484 WatchSource:0}: Error finding container 335cb9330efc0734ed7350fc9811a05cfa0ad017be7855dd10836ce1290f7484: Status 404 returned error can't find the container with id 335cb9330efc0734ed7350fc9811a05cfa0ad017be7855dd10836ce1290f7484
Jul 18 02:41:30.590588 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:30.590545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:30.640246 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:30.640185    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:31.256870 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.256826    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl" event={"ID":"ad49cae8-eba7-40d1-bad5-7e484970f8cf","Type":"ContainerStarted","Data":"0a5d94dc79997461c91c651099e0954f88d7cc07139167e2ad31d63c4119e11f"}
Jul 18 02:41:31.257096 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.256903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl" event={"ID":"ad49cae8-eba7-40d1-bad5-7e484970f8cf","Type":"ContainerStarted","Data":"318d57cd6c0ac2543284b11d48a27ebfc0f55087063b5a5ea52af91b48cc2d65"}
Jul 18 02:41:31.257096 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.256938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl" event={"ID":"ad49cae8-eba7-40d1-bad5-7e484970f8cf","Type":"ContainerStarted","Data":"2512920db109508da18ff3e54f8fa5cd3075125b507bd60b424a1e911310a93c"}
Jul 18 02:41:31.263004 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.262893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"335cb9330efc0734ed7350fc9811a05cfa0ad017be7855dd10836ce1290f7484"}
Jul 18 02:41:31.267242 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.267201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bntwv" event={"ID":"47c69a13-f6e6-452b-b87d-b34c40b564ce","Type":"ContainerStarted","Data":"c43ed7f0b11f391865e5ec80163bb99aff5907594b5aa8402d49af2875354ca1"}
Jul 18 02:41:31.267950 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.267564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:31.270563 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.270540    2567 generic.go:356] "Generic (PLEG): container finished" podID="b656138f-3754-4f7a-be3a-43f522e81e61" containerID="0262a01681483d59e5c2f76c1e78b63035a421a7779543da6204d6f2468554da" exitCode=0
Jul 18 02:41:31.270720 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.270632    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29n7v" event={"ID":"b656138f-3754-4f7a-be3a-43f522e81e61","Type":"ContainerDied","Data":"0262a01681483d59e5c2f76c1e78b63035a421a7779543da6204d6f2468554da"}
Jul 18 02:41:31.272586 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.272565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"453846b038ea48c34224e3c551d4d909d5bd58d468afa6e1ceb7d59fab89c3d0"}
Jul 18 02:41:31.275228 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.275204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdhgd" event={"ID":"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7","Type":"ContainerStarted","Data":"a9a96c55fe06fbecddb79d95cb1c785cbe216d7c288243af2788f44e89aedbff"}
Jul 18 02:41:31.280209 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.279778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s" event={"ID":"33243675-6aa1-43d9-85b2-59ee84ef8228","Type":"ContainerStarted","Data":"61caabbec8e49be65d4a553ab650f78f1bd7c3b2b4473b4f7873d4e76c6a41f8"}
Jul 18 02:41:31.281012 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.280940    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-bntwv"
Jul 18 02:41:31.283104 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.282975    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-7rpvl" podStartSLOduration=3.258155822 podStartE2EDuration="15.282957939s" totalImagesPullingTime="12.024802117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:31.281807964 +0000 UTC m=+87.933859666" watchObservedRunningTime="2026-07-18 02:41:31.282957939 +0000 UTC m=+87.935009641"
Jul 18 02:41:31.326728 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.325496    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bwv8s" podStartSLOduration=3.394774609 podStartE2EDuration="15.325476874s" totalImagesPullingTime="11.930702265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:31.325005949 +0000 UTC m=+87.977057654" watchObservedRunningTime="2026-07-18 02:41:31.325476874 +0000 UTC m=+87.977528575"
Jul 18 02:41:31.326728 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:31.325774    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-bntwv" podStartSLOduration=1.918512826 podStartE2EDuration="24.325765125s" totalImagesPullingTime="22.407252299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:31.299484795 +0000 UTC m=+87.951536497" watchObservedRunningTime="2026-07-18 02:41:31.325765125 +0000 UTC m=+87.977816821"
Jul 18 02:41:32.244068 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.241937    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" podUID="cf2f7846-9553-426c-b0c3-91867a47db55" containerName="registry" containerID="cri-o://28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6" gracePeriod=30
Jul 18 02:41:32.291464 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.291007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29n7v" event={"ID":"b656138f-3754-4f7a-be3a-43f522e81e61","Type":"ContainerStarted","Data":"2d575fc3392baa2ea6a81ac9ba74fe1b7c406ce87027fa8eafcca2c4dff5d2da"}
Jul 18 02:41:32.291464 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.291083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29n7v" event={"ID":"b656138f-3754-4f7a-be3a-43f522e81e61","Type":"ContainerStarted","Data":"ae50ced78426dcfd8498a9a7654d13456cc4ea3c9d8fff990bcf287fb81a591b"}
Jul 18 02:41:32.320673 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.319454    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-29n7v" podStartSLOduration=4.420321345 podStartE2EDuration="16.319434668s" totalImagesPullingTime="11.762781526s" totalInitContainerRuntime="136.331797ms" isStatefulPod=true podCreationTimestamp="2026-07-18 02:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:32.317712733 +0000 UTC m=+88.969764449" watchObservedRunningTime="2026-07-18 02:41:32.319434668 +0000 UTC m=+88.971486370"
Jul 18 02:41:32.629389 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.629145    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816674    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816735    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5l56\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816761    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816855    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816884    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816923    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.817575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.816952    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates\") pod \"cf2f7846-9553-426c-b0c3-91867a47db55\" (UID: \"cf2f7846-9553-426c-b0c3-91867a47db55\") "
Jul 18 02:41:32.820482 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.820077    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:41:32.820876 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.820717    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:41:32.824651 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.824497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:41:32.824763 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.824710    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56" (OuterVolumeSpecName: "kube-api-access-t5l56") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "kube-api-access-t5l56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:41:32.825138 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.825070    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:41:32.826642 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.826603    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:41:32.827350 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.827316    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:41:32.831877 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.831823    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf2f7846-9553-426c-b0c3-91867a47db55" (UID: "cf2f7846-9553-426c-b0c3-91867a47db55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:41:32.917959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.917918    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf2f7846-9553-426c-b0c3-91867a47db55-ca-trust-extracted\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.917959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.917958    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-registry-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.917975    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-trusted-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.918024    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-image-registry-private-configuration\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.918037    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf2f7846-9553-426c-b0c3-91867a47db55-registry-certificates\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.918046    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-bound-sa-token\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.918054    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5l56\" (UniqueName: \"kubernetes.io/projected/cf2f7846-9553-426c-b0c3-91867a47db55-kube-api-access-t5l56\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:32.918224 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:32.918066    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf2f7846-9553-426c-b0c3-91867a47db55-installation-pull-secrets\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:41:33.297880 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.297778    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82" exitCode=0
Jul 18 02:41:33.298133 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.297875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"}
Jul 18 02:41:33.300499 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.300422    2567 generic.go:356] "Generic (PLEG): container finished" podID="cf2f7846-9553-426c-b0c3-91867a47db55" containerID="28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6" exitCode=0
Jul 18 02:41:33.304737 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.300887    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz"
Jul 18 02:41:33.304737 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.304117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" event={"ID":"cf2f7846-9553-426c-b0c3-91867a47db55","Type":"ContainerDied","Data":"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"}
Jul 18 02:41:33.304737 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.304166    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b784fbb8-zxmnz" event={"ID":"cf2f7846-9553-426c-b0c3-91867a47db55","Type":"ContainerDied","Data":"de7ad4696639c284d5f715600fed90a31f0815ed95da4af4d693e5156cc3b5c7"}
Jul 18 02:41:33.304737 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.304195    2567 scope.go:117] "RemoveContainer" containerID="28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"
Jul 18 02:41:33.350566 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.350514    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:41:33.374370 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.374283    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65b784fbb8-zxmnz"]
Jul 18 02:41:33.779792 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:33.779754    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2f7846-9553-426c-b0c3-91867a47db55" path="/var/lib/kubelet/pods/cf2f7846-9553-426c-b0c3-91867a47db55/volumes"
Jul 18 02:41:34.368747 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:34.368712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:35.056319 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:35.056251    2567 scope.go:117] "RemoveContainer" containerID="28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"
Jul 18 02:41:35.056671 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:41:35.056647    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6\": container with ID starting with 28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6 not found: ID does not exist" containerID="28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"
Jul 18 02:41:35.056726 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:35.056682    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6"} err="failed to get container status \"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6\": rpc error: code = NotFound desc = could not find container \"28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6\": container with ID starting with 28f365c1b9b5611850da266020cf45ce052176aa558aa81dda6a284e792ad8b6 not found: ID does not exist"
Jul 18 02:41:37.017414 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:37.017347    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:37.111932 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:37.111898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:37.170000 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:37.169949    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:40.340876 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.340836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"}
Jul 18 02:41:40.341444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.340916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"}
Jul 18 02:41:40.341444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.340961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"}
Jul 18 02:41:40.341444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.341038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"}
Jul 18 02:41:40.341444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.341081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"}
Jul 18 02:41:40.341444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.341118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerStarted","Data":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"}
Jul 18 02:41:40.343449 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.343418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"cb1e2f1d481f1aa6bf55ecbe5292232cdec870d0319b786bb056cab616ee9c56"}
Jul 18 02:41:40.343567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.343495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"9413d8327cc17e281e324a82d3607d0e4a220f1a5f734c84a3dba2d178aa488b"}
Jul 18 02:41:40.343567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.343536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"303407ce82d59b2fe963660d5c88b238a9aa84fd975871a7bb048f0923fb413c"}
Jul 18 02:41:40.346639 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.346616    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdhgd" event={"ID":"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7","Type":"ContainerStarted","Data":"febe4b1f971d72e19689e945e1366a40a1284aae1b4cb6e445f9a63e4c8bb149"}
Jul 18 02:41:40.369791 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:40.368111    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.162835908 podStartE2EDuration="17.368087251s" totalImagesPullingTime="8.182236156s" totalInitContainerRuntime="23.015187ms" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:40.366794791 +0000 UTC m=+97.018846550" watchObservedRunningTime="2026-07-18 02:41:40.368087251 +0000 UTC m=+97.020139147"
Jul 18 02:41:41.354758 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:41.354722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"738e0733e3aa548c4cae3b7844ea5c296a70e6797b99964a8ef760fbdd74d4c1"}
Jul 18 02:41:41.355185 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:41.354847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"cfe0f4b2b48b42bc5273a50175cad15e088592c4a45bb758abcce0e27d0dece5"}
Jul 18 02:41:41.703432 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:41.703397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:41.802640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:41.802607    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:42.363333 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:42.363293    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" event={"ID":"397579a0-0100-4ea0-80be-3320701cf482","Type":"ContainerStarted","Data":"98f515bbd46c796df1adb0c63766b5940e53d27b62655effe991f6771d91820b"}
Jul 18 02:41:42.363807 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:42.363431    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:42.385600 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:42.385529    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l" podStartSLOduration=13.104047204 podStartE2EDuration="23.385505556s" totalImagesPullingTime="10.281458352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:41:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:42.384127614 +0000 UTC m=+99.036179318" watchObservedRunningTime="2026-07-18 02:41:42.385505556 +0000 UTC m=+99.037557271"
Jul 18 02:41:43.438131 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.438091    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:43.486929 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.486902    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:43.511934 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.511908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:41:43.542521 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.542490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:43.783091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.783021    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:43.855691 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:43.855665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:44.372626 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:44.372591    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vdhgd" event={"ID":"6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7","Type":"ContainerStarted","Data":"ac33e4ff22ce11601feb2cf002740ae9e74d8bf8dba2a2260caac2b2df234389"}
Jul 18 02:41:44.392451 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:44.392402    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vdhgd" podStartSLOduration=36.902394716 podStartE2EDuration="1m4.392388445s" totalImagesPullingTime="27.489993729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:40:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:41:44.390677066 +0000 UTC m=+101.042728768" watchObservedRunningTime="2026-07-18 02:41:44.392388445 +0000 UTC m=+101.044440145"
Jul 18 02:41:46.240227 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:46.240196    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lvfnm_ecb5e8ec-0a6a-4a53-9ceb-0266de781b38/serve-healthcheck-canary/0.log"
Jul 18 02:41:47.201453 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:47.201418    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2w5bm"
Jul 18 02:41:48.374263 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:48.374241    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5994bbbbd5-jsb8l"
Jul 18 02:41:48.910334 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:48.910296    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:49.012006 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:49.011958    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:49.111336 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:49.111303    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:49.721177 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:49.721143    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:41:49.778789 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:41:49.778762    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:14.571882 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:14.571851    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:23.511536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:23.511484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:23.563720 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:23.563690    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:23.579564 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:23.579538    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:33.074310 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:33.074272    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:33.135163 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:33.135138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:41.528342 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.528290    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.528934    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="prometheus" containerID="cri-o://0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6" gracePeriod=600
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.529231    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy" containerID="cri-o://5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3" gracePeriod=600
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.529381    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-web" containerID="cri-o://9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b" gracePeriod=600
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.529443    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725" gracePeriod=600
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.529520    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="config-reloader" containerID="cri-o://6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58" gracePeriod=600
Jul 18 02:42:41.532129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.529565    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="thanos-sidecar" containerID="cri-o://18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d" gracePeriod=600
Jul 18 02:42:41.774149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.774123    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:41.872149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872126    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872178    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872245    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j52js\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872325 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872265    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872621 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872452    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872621 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872493    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872621 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872525    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872621 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872621 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872558    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872630    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872629    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872641    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872652    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872695    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872725    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872758    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872829    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.872865 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872862    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.873480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.872894    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy\") pod \"c77c7769-bbd9-442e-9ec1-6579896f12f3\" (UID: \"c77c7769-bbd9-442e-9ec1-6579896f12f3\") "
Jul 18 02:42:41.873480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.873134    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.873480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.873211    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.873480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.873332    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.873480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.873348    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.874053 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.874027    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:42:41.874348 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.874313    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.875504 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.874454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.875975 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.875905    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.875975 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.875910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:42:41.876975 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.876938    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.877096 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877036    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out" (OuterVolumeSpecName: "config-out") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:42:41.877605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877556    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js" (OuterVolumeSpecName: "kube-api-access-j52js") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "kube-api-access-j52js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:42:41.877605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877560    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.877605 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.877768 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877628    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config" (OuterVolumeSpecName: "config") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.877768 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877696    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:42:41.877836 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877775    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.878015 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.877972    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.878067 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.878059    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.886843 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.886821    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config" (OuterVolumeSpecName: "web-config") pod "c77c7769-bbd9-442e-9ec1-6579896f12f3" (UID: "c77c7769-bbd9-442e-9ec1-6579896f12f3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:42:41.974493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974468    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j52js\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-kube-api-access-j52js\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974489    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-web-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974497    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c77c7769-bbd9-442e-9ec1-6579896f12f3-tls-assets\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974505    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974514    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974524    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974534    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-grpc-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974542    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974551    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-metrics-client-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974559    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-configmap-metrics-client-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974568    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974576    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974583    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-config-out\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974591    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974599    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c77c7769-bbd9-442e-9ec1-6579896f12f3-secret-kube-rbac-proxy\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:41.974671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:41.974607    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c77c7769-bbd9-442e-9ec1-6579896f12f3-prometheus-k8s-db\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599660    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725" exitCode=0
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599688    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3" exitCode=0
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599696    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b" exitCode=0
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599704    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d" exitCode=0
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599711    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58" exitCode=0
Jul 18 02:42:42.599733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599718    2567 generic.go:356] "Generic (PLEG): container finished" podID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6" exitCode=0
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599753    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599845    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599885    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599894    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"}
Jul 18 02:42:42.600243 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.599943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c77c7769-bbd9-442e-9ec1-6579896f12f3","Type":"ContainerDied","Data":"335cb9330efc0734ed7350fc9811a05cfa0ad017be7855dd10836ce1290f7484"}
Jul 18 02:42:42.608974 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.608960    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.615619 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.615601    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.622103 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.622084    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:42.622824 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.622808    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.626797 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.626777    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:42.629733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.629713    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.636252 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.636238    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.643212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.643194    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.649878 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.649854    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.650178 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.650150    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.650251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650174    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.650251 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650196    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.650433 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.650417    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.650473 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650436    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.650473 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650449    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.650541 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650493    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:42.650657 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.650642    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.650697 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650660    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.650697 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650674    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.650775 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650759    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2f7846-9553-426c-b0c3-91867a47db55" containerName="registry"
Jul 18 02:42:42.650775 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650772    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2f7846-9553-426c-b0c3-91867a47db55" containerName="registry"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650781    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-web"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650790    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-web"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650802    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="prometheus"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650809    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="prometheus"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650818    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="config-reloader"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650826    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="config-reloader"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650836    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="init-config-reloader"
Jul 18 02:42:42.650850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650840    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="init-config-reloader"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650854    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650862    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650870    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-thanos"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650876    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-thanos"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650884    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="thanos-sidecar"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650889    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="thanos-sidecar"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650930    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="prometheus"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650940    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-web"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650949    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="config-reloader"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650954    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="thanos-sidecar"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650961    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf2f7846-9553-426c-b0c3-91867a47db55" containerName="registry"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.650972    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" containerName="kube-rbac-proxy-thanos"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.650857    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651029    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.651091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651049    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.651323    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651340    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651352    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.651557    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651580    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.651640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651599    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.651862 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:42:42.651829    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.651862 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651847    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.651862 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.651860    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.652065 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652045    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.652144 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652068    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.652315 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652295    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.652359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652316    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.652514 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652493    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.652551 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652515    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.652730 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652713    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.652797 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652732    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.652972 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652955    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.653029 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.652973    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.653203 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653186    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.653247 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653204    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.653410 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653392    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.653472 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653409    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.653613 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653597    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.653665 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653613    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.653799 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653778    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.653851 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.653804    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.654064 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654047    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.654113 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654064    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.654260 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654245    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.654301 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654260    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.654468 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654447    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.654536 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654469    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.654722 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654698    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.654722 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654716    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.654930 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654913    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.654979 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.654930    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.655174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655151    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.655260 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655175    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.655413 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655394    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.655466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655419    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.655631 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655609    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.655679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655634    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.655844 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655826    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.655888 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.655845    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.656076 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656059    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.656124 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656076    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.656300 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656281    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.656300 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656299    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.656380 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656300    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.656712 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656528    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.656712 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656558    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.656910 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656892    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.657001 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.656913    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.657163 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657141    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.657242 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657166    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.657415 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657392    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.657491 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657416    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.657631 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657615    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.657695 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657633    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.657843 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657825    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.657913 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.657845    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.658098 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658080    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.658158 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658099    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.658276 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658261    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.658319 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658277    2567 scope.go:117] "RemoveContainer" containerID="c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"
Jul 18 02:42:42.658493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658478    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725"} err="failed to get container status \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": rpc error: code = NotFound desc = could not find container \"c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725\": container with ID starting with c842b27cec24c19d8d8d073f16469f24bb48dc8be73401a7572a5bc312971725 not found: ID does not exist"
Jul 18 02:42:42.658545 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658493    2567 scope.go:117] "RemoveContainer" containerID="5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"
Jul 18 02:42:42.658685 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658662    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3"} err="failed to get container status \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": rpc error: code = NotFound desc = could not find container \"5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3\": container with ID starting with 5c9ac4af6d75154e0fa81ec361d5bb17c65997af8b2a247e606a5df836251aa3 not found: ID does not exist"
Jul 18 02:42:42.658685 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658685    2567 scope.go:117] "RemoveContainer" containerID="9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658837    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658879    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658892    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658893    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b"} err="failed to get container status \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": rpc error: code = NotFound desc = could not find container \"9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b\": container with ID starting with 9635e7a879cf3f0053be2648edfbd7d71e2694d50207eca8f28da85e8fea447b not found: ID does not exist"
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658904    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3reobe0ueue0d\""
Jul 18 02:42:42.658923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.658913    2567 scope.go:117] "RemoveContainer" containerID="18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"
Jul 18 02:42:42.659359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659163    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d"} err="failed to get container status \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": rpc error: code = NotFound desc = could not find container \"18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d\": container with ID starting with 18203b0591d65d3fd488733da48ea55f0f3c29ea5307ef0e3afa9dc10220655d not found: ID does not exist"
Jul 18 02:42:42.659359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659185    2567 scope.go:117] "RemoveContainer" containerID="6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"
Jul 18 02:42:42.659359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659237    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 02:42:42.659359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659277    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 02:42:42.659359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659297    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 02:42:42.659714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659415    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58"} err="failed to get container status \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": rpc error: code = NotFound desc = could not find container \"6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58\": container with ID starting with 6ba38b96f83527ae65017e2e89288b229a98151d2a9d51fa8b8fc01d501fbe58 not found: ID does not exist"
Jul 18 02:42:42.659714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659435    2567 scope.go:117] "RemoveContainer" containerID="0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"
Jul 18 02:42:42.659714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659615    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 02:42:42.659714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659665    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6"} err="failed to get container status \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": rpc error: code = NotFound desc = could not find container \"0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6\": container with ID starting with 0a69a829fda4c717dcc528a359189c3e0836ba0b39a93a0e748764d138c6f5c6 not found: ID does not exist"
Jul 18 02:42:42.659714 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659685    2567 scope.go:117] "RemoveContainer" containerID="e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"
Jul 18 02:42:42.660046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659798    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 02:42:42.660046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659810    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bkmgg\""
Jul 18 02:42:42.660046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.659977    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82"} err="failed to get container status \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": rpc error: code = NotFound desc = could not find container \"e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82\": container with ID starting with e9403c0b8568fe376ee5ecf1a5c2fc3a6cfbfb1d6610b0177579ad5eb939be82 not found: ID does not exist"
Jul 18 02:42:42.660046 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.660027    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 02:42:42.660373 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.660164    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 02:42:42.660373 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.660206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 02:42:42.660631 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.660613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 02:42:42.660803 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.660771    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 02:42:42.662245 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.662205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 02:42:42.664808 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.664793    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 02:42:42.670721 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.670703    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:42.679214 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679302 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679302 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679246    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679302 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679302 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679466 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqz9\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-kube-api-access-2nqz9\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679670    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679705 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-web-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679914 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-config-out\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679914 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.679914 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.679764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780353 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780393    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780520 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780778 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780778 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.780778 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.782068 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.781449    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.782068 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.781865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.782068 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.781978    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.780595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqz9\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-kube-api-access-2nqz9\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-web-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-config-out\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.783587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.782942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.784821 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.784794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.785075 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.785051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.785541 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.785518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.786178 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.786151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.786444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.786418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.787241 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.787217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1156d2c6-f9fa-46b4-9197-169f88837cec-config-out\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.787833 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.787814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1156d2c6-f9fa-46b4-9197-169f88837cec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.788410 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.788382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.788821 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.788795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.789023 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.788977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.792408 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.792318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.792408 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.792391    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.792408 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.792447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.792711 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.792450    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.793830 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.793802    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1156d2c6-f9fa-46b4-9197-169f88837cec-web-config\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.794314 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.794299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqz9\" (UniqueName: \"kubernetes.io/projected/1156d2c6-f9fa-46b4-9197-169f88837cec-kube-api-access-2nqz9\") pod \"prometheus-k8s-0\" (UID: \"1156d2c6-f9fa-46b4-9197-169f88837cec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:42.965871 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:42.965837    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:43.100398 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:43.100326    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 02:42:43.102496 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:42:43.102471    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1156d2c6_f9fa_46b4_9197_169f88837cec.slice/crio-7f0227c4a17ea53d3d8f51564335ab2c76e6bda23ac2bf4c51bd5fb26878afd0 WatchSource:0}: Error finding container 7f0227c4a17ea53d3d8f51564335ab2c76e6bda23ac2bf4c51bd5fb26878afd0: Status 404 returned error can't find the container with id 7f0227c4a17ea53d3d8f51564335ab2c76e6bda23ac2bf4c51bd5fb26878afd0
Jul 18 02:42:43.605301 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:43.605266    2567 generic.go:356] "Generic (PLEG): container finished" podID="1156d2c6-f9fa-46b4-9197-169f88837cec" containerID="5612d616ffc8d551600fe1079521cd351ffd7cc0ab89fabae141ce11f77abd88" exitCode=0
Jul 18 02:42:43.605739 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:43.605314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerDied","Data":"5612d616ffc8d551600fe1079521cd351ffd7cc0ab89fabae141ce11f77abd88"}
Jul 18 02:42:43.605739 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:43.605365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"7f0227c4a17ea53d3d8f51564335ab2c76e6bda23ac2bf4c51bd5fb26878afd0"}
Jul 18 02:42:43.773806 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:43.773781    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77c7769-bbd9-442e-9ec1-6579896f12f3" path="/var/lib/kubelet/pods/c77c7769-bbd9-442e-9ec1-6579896f12f3/volumes"
Jul 18 02:42:44.612711 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"856bb3ac5e4e7150eb0593de3c476ee2d3fa17b1cc8b5805a78114f7bb9e3ace"}
Jul 18 02:42:44.613102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"16ac371309ed414719aacd380c23f2f508ebd18b85a2cc5518bc38824d1ec1e7"}
Jul 18 02:42:44.613102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"1915ee40b123f24adff55636a265cd74badaabbab9593abaaa0db87c3588424f"}
Jul 18 02:42:44.613102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"229622acd985ea8aca166a06d65abcd305fa53e2fca93573e418df0f37e22c65"}
Jul 18 02:42:44.613102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"2fda06f23990a9925266b88abb4f090b988488b3326765910cd4dbeefd55a6b6"}
Jul 18 02:42:44.613102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.612849    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1156d2c6-f9fa-46b4-9197-169f88837cec","Type":"ContainerStarted","Data":"7edf7083f6e751d0341f4027edb2f47d3438be5c71ae49952302ddab8cbdd719"}
Jul 18 02:42:44.642273 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.642209    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.622752642 podStartE2EDuration="2.642188942s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.4363ms" isStatefulPod=false podCreationTimestamp="2026-07-18 02:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:42:44.639037176 +0000 UTC m=+161.291088878" watchObservedRunningTime="2026-07-18 02:42:44.642188942 +0000 UTC m=+161.294240648"
Jul 18 02:42:44.973190 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:44.973114    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:45.027041 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:45.027009    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:47.966569 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:47.966527    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:42:56.907256 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:56.907182    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:58.814781 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:58.814751    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:58.914092 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:58.914048    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:42:58.979342 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:42:58.979313    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:09.789253 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:09.789212    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:09.891371 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:09.891338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:09.940859 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:09.940831    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:16.394543 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:16.394512    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:17.414593 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:17.414562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:17.512445 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:17.512415    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:42.966798 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:42.966761    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:43:42.982819 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:42.982795    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:43:43.845052 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:43.845024    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 02:43:44.162394 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:44.162362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:44.967433 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:44.967395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:47.777533 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:47.777506    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:47.877226 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:47.877195    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:49.158286 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:49.158250    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:49.323299 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:49.323268    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:49.733568 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:49.733540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:49.832961 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:49.832931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:52.136347 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:52.136317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:52.548877 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:52.548790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:54.570159 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:54.570128    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:54.622616 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:54.622590    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:59.109625 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:59.109562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:59.211853 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:59.211801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:43:59.761423 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:43:59.761388    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:00.141553 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.141520    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k6ms5"]
Jul 18 02:44:00.144693 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.144677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.147254 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.147224    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2h277\""
Jul 18 02:44:00.147408 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.147289    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 02:44:00.148019 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.148003    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 02:44:00.154597 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.154575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k6ms5"]
Jul 18 02:44:00.184298 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.184273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-bound-sa-token\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.184427 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.184310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22wd\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-kube-api-access-k22wd\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.285039 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.285015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-bound-sa-token\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.285163 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.285052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k22wd\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-kube-api-access-k22wd\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.293160 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.293135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-bound-sa-token\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.293274 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.293189    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22wd\" (UniqueName: \"kubernetes.io/projected/5987e0e1-f3c0-4267-a93c-3ddd64006d53-kube-api-access-k22wd\") pod \"cert-manager-55b4d954d5-k6ms5\" (UID: \"5987e0e1-f3c0-4267-a93c-3ddd64006d53\") " pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.465495 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.465411    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k6ms5"
Jul 18 02:44:00.586456 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.586424    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:00.595534 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.595507    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k6ms5"]
Jul 18 02:44:00.598863 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:44:00.598840    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5987e0e1_f3c0_4267_a93c_3ddd64006d53.slice/crio-da24e6ae7d6ffc0bc05f901553dfe2b8f8746ffccbeec93bdad2483c6396dbe6 WatchSource:0}: Error finding container da24e6ae7d6ffc0bc05f901553dfe2b8f8746ffccbeec93bdad2483c6396dbe6: Status 404 returned error can't find the container with id da24e6ae7d6ffc0bc05f901553dfe2b8f8746ffccbeec93bdad2483c6396dbe6
Jul 18 02:44:00.680665 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.680637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:00.888225 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:00.888195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k6ms5" event={"ID":"5987e0e1-f3c0-4267-a93c-3ddd64006d53","Type":"ContainerStarted","Data":"da24e6ae7d6ffc0bc05f901553dfe2b8f8746ffccbeec93bdad2483c6396dbe6"}
Jul 18 02:44:03.901338 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:03.901303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k6ms5" event={"ID":"5987e0e1-f3c0-4267-a93c-3ddd64006d53","Type":"ContainerStarted","Data":"409e9ffbd02d1ba7f41be5c2b339422a8abbc25a922d4336fd8f4720428007f7"}
Jul 18 02:44:03.916045 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:03.915972    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k6ms5" podStartSLOduration=0.995426635 podStartE2EDuration="3.915955671s" totalImagesPullingTime="2.920529036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:44:03.915098161 +0000 UTC m=+240.567149864" watchObservedRunningTime="2026-07-18 02:44:03.915955671 +0000 UTC m=+240.568007371"
Jul 18 02:44:06.647204 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:06.647176    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:06.747179 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:06.747152    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:08.628236 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:08.628186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:20.678775 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:20.678731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:23.012104 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:23.012065    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:23.112797 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:23.112769    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:23.592091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:23.592046    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:23.826908 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:23.826881    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:23.927859 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:23.927815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.045524 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.045495    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"]
Jul 18 02:44:24.048745 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.048728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.052083 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.052053    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 02:44:24.052197 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.052136    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 02:44:24.052260 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.052199    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 02:44:24.052356 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.052341    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 02:44:24.052426 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.052412    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gxrnd\""
Jul 18 02:44:24.073386 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.073364    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"]
Jul 18 02:44:24.184712 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.184631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-manifests\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.184712 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.184666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.184902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.184721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6sm\" (UniqueName: \"kubernetes.io/projected/7c26475a-9e26-492f-8d03-ebf9e768cb72-kube-api-access-tr6sm\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.184902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.184770    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-tmp\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.184902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.184795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.226609 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.226585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.285805 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.285776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-tmp\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.285919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.285812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.285919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.285859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-manifests\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.285919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.285877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.285919 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.285908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6sm\" (UniqueName: \"kubernetes.io/projected/7c26475a-9e26-492f-8d03-ebf9e768cb72-kube-api-access-tr6sm\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.286345 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.286316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-manifests\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.288263 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.288240    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c26475a-9e26-492f-8d03-ebf9e768cb72-tmp\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.288553 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.288537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.288597 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.288557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c26475a-9e26-492f-8d03-ebf9e768cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.293721 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.293695    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6sm\" (UniqueName: \"kubernetes.io/projected/7c26475a-9e26-492f-8d03-ebf9e768cb72-kube-api-access-tr6sm\") pod \"opendatahub-operator-controller-manager-5f9896c96c-cdncl\" (UID: \"7c26475a-9e26-492f-8d03-ebf9e768cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.327443 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.327414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.358031 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.358008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:24.427372 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.427320    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.503385 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.503354    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.539280 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.539252    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"]
Jul 18 02:44:24.542657 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:44:24.542630    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c26475a_9e26_492f_8d03_ebf9e768cb72.slice/crio-97ded04604df81abf47952a173d689972f0b1375652a8a0f41a81f841a246dac WatchSource:0}: Error finding container 97ded04604df81abf47952a173d689972f0b1375652a8a0f41a81f841a246dac: Status 404 returned error can't find the container with id 97ded04604df81abf47952a173d689972f0b1375652a8a0f41a81f841a246dac
Jul 18 02:44:24.564661 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.564637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.671722 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.671613    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:24.978149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:24.978109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl" event={"ID":"7c26475a-9e26-492f-8d03-ebf9e768cb72","Type":"ContainerStarted","Data":"97ded04604df81abf47952a173d689972f0b1375652a8a0f41a81f841a246dac"}
Jul 18 02:44:27.992097 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:27.992019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl" event={"ID":"7c26475a-9e26-492f-8d03-ebf9e768cb72","Type":"ContainerStarted","Data":"e25b61b0390d35e0930073d44adcc409b970a1a15ccef5aacba3a4d2a0d4398f"}
Jul 18 02:44:28.997163 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:28.997073    2567 generic.go:356] "Generic (PLEG): container finished" podID="7c26475a-9e26-492f-8d03-ebf9e768cb72" containerID="e25b61b0390d35e0930073d44adcc409b970a1a15ccef5aacba3a4d2a0d4398f" exitCode=0
Jul 18 02:44:28.997489 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:28.997162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl" event={"ID":"7c26475a-9e26-492f-8d03-ebf9e768cb72","Type":"ContainerDied","Data":"e25b61b0390d35e0930073d44adcc409b970a1a15ccef5aacba3a4d2a0d4398f"}
Jul 18 02:44:30.002699 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:30.002664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl" event={"ID":"7c26475a-9e26-492f-8d03-ebf9e768cb72","Type":"ContainerStarted","Data":"9adf91758a6e18956a04d9f7166b9dbcb9b99b0b170fda45d6fe0a3f3ccd9ca1"}
Jul 18 02:44:30.003173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:30.002777    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:30.027157 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:30.027101    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl" podStartSLOduration=1.551918651 podStartE2EDuration="6.027081589s" totalImagesPullingTime="3.404247385s" totalInitContainerRuntime="1.070915553s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:44:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:44:30.026305022 +0000 UTC m=+266.678356724" watchObservedRunningTime="2026-07-18 02:44:30.027081589 +0000 UTC m=+266.679133291"
Jul 18 02:44:30.901812 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:30.901771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:30.965449 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:30.965423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:38.275529 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:38.275491    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:38.350970 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:38.350943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:41.009040 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.009005    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f9896c96c-cdncl"
Jul 18 02:44:41.446866 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.446824    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"]
Jul 18 02:44:41.455120 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.455091    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.457494 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.457471    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 02:44:41.457649 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.457610    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f2m9s\""
Jul 18 02:44:41.457968 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.457951    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 02:44:41.458073 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.457972    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 02:44:41.458073 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.458023    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 02:44:41.458320 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.458303    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 02:44:41.462950 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.462919    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"]
Jul 18 02:44:41.522626 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.522585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-metrics-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.522790 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.522691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjb8\" (UniqueName: \"kubernetes.io/projected/947fdcd8-59cb-4647-ac50-9d06d1314213-kube-api-access-dgjb8\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.522790 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.522717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.522790 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.522765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947fdcd8-59cb-4647-ac50-9d06d1314213-manager-config\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.623695 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.623646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjb8\" (UniqueName: \"kubernetes.io/projected/947fdcd8-59cb-4647-ac50-9d06d1314213-kube-api-access-dgjb8\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.623695 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.623694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.623960 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.623725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947fdcd8-59cb-4647-ac50-9d06d1314213-manager-config\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.623960 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.623754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-metrics-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.624398 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.624380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947fdcd8-59cb-4647-ac50-9d06d1314213-manager-config\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.626433 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.626406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-metrics-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.626433 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.626424    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947fdcd8-59cb-4647-ac50-9d06d1314213-cert\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.632885 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.632863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjb8\" (UniqueName: \"kubernetes.io/projected/947fdcd8-59cb-4647-ac50-9d06d1314213-kube-api-access-dgjb8\") pod \"lws-controller-manager-59945b78f9-5kwj2\" (UID: \"947fdcd8-59cb-4647-ac50-9d06d1314213\") " pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.765922 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.765860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:41.895542 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:41.895511    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"]
Jul 18 02:44:41.898293 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:44:41.898256    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947fdcd8_59cb_4647_ac50_9d06d1314213.slice/crio-74feb5330fe3cd123a3eebbc73874804f932fa77410add685fed3bc72382d2db WatchSource:0}: Error finding container 74feb5330fe3cd123a3eebbc73874804f932fa77410add685fed3bc72382d2db: Status 404 returned error can't find the container with id 74feb5330fe3cd123a3eebbc73874804f932fa77410add685fed3bc72382d2db
Jul 18 02:44:42.050165 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:42.050069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2" event={"ID":"947fdcd8-59cb-4647-ac50-9d06d1314213","Type":"ContainerStarted","Data":"74feb5330fe3cd123a3eebbc73874804f932fa77410add685fed3bc72382d2db"}
Jul 18 02:44:42.787576 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:42.787541    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:42.919076 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:42.919040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:43.425652 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.425623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:43.602691 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.602658    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"]
Jul 18 02:44:43.610963 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.610938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.615384 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.615359    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 02:44:43.615800 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.615778    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 02:44:43.615902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.615805    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 02:44:43.615902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.615808    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kb2fh\""
Jul 18 02:44:43.615902 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.615837    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 02:44:43.624114 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.624090    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"]
Jul 18 02:44:43.642480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.642444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.642620 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.642521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x42\" (UniqueName: \"kubernetes.io/projected/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-kube-api-access-94x42\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.642620 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.642560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tmp\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.743969 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.743891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94x42\" (UniqueName: \"kubernetes.io/projected/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-kube-api-access-94x42\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.743969 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.743936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tmp\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.744467 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.744015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.744467 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:44:43.744138    2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 18 02:44:43.744467 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:44:43.744200    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs podName:0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0 nodeName:}" failed. No retries permitted until 2026-07-18 02:44:44.244180065 +0000 UTC m=+280.896231749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs") pod "kube-auth-proxy-58dcbd754f-jzw6l" (UID: "0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0") : secret "kube-auth-proxy-tls" not found
Jul 18 02:44:43.746867 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.746837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tmp\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.761210 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.757976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x42\" (UniqueName: \"kubernetes.io/projected/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-kube-api-access-94x42\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:43.963241 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:43.963213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.072730 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.072606    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.247756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.247724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:44.250528 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.250500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0-tls-certs\") pod \"kube-auth-proxy-58dcbd754f-jzw6l\" (UID: \"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0\") " pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:44.266796 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.266754    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.407658 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.407621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.523373 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.523341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"
Jul 18 02:44:44.666149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.666050    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l"]
Jul 18 02:44:44.669465 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:44:44.669439    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba62ef0_7dfb_41fc_8b55_4842f79d8fc0.slice/crio-4d306ad023b4610697259f2fcfafd88cc2f30ff17e9db68d7946573a088b0402 WatchSource:0}: Error finding container 4d306ad023b4610697259f2fcfafd88cc2f30ff17e9db68d7946573a088b0402: Status 404 returned error can't find the container with id 4d306ad023b4610697259f2fcfafd88cc2f30ff17e9db68d7946573a088b0402
Jul 18 02:44:44.760841 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.760793    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.838239 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.838187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:44.997097 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:44.997020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:45.069248 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.069206    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2" event={"ID":"947fdcd8-59cb-4647-ac50-9d06d1314213","Type":"ContainerStarted","Data":"e712f4a0757fd8e024a778f8eb942326da2d654ba398cc80d7e38ce00f5c9dcd"}
Jul 18 02:44:45.069453 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.069320    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:45.070356 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.070334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l" event={"ID":"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0","Type":"ContainerStarted","Data":"4d306ad023b4610697259f2fcfafd88cc2f30ff17e9db68d7946573a088b0402"}
Jul 18 02:44:45.087174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.087130    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2" podStartSLOduration=1.448815682 podStartE2EDuration="4.087117116s" totalImagesPullingTime="2.638301434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:44:45.084903311 +0000 UTC m=+281.736955011" watchObservedRunningTime="2026-07-18 02:44:45.087117116 +0000 UTC m=+281.739168816"
Jul 18 02:44:45.127445 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.127414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:45.993259 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:45.993226    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:47.082968 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:47.082926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l" event={"ID":"0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0","Type":"ContainerStarted","Data":"911df713b69b9bb9b12e27801b77d89850c3d90e985d865c431631f98dd9da11"}
Jul 18 02:44:50.624676 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:50.624641    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:50.716149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:50.716118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:50.908031 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:50.907942    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:51.089642 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:51.089612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:51.335971 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:51.335894    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:53.915869 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:53.915834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:54.019436 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:54.019387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:54.115926 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:54.115885    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:54.574874 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:54.574841    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:55.252319 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:55.252279    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:55.338255 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:55.338204    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:55.437943 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:55.437910    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:44:56.077679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:56.077646    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59945b78f9-5kwj2"
Jul 18 02:44:56.095237 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:44:56.095189    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58dcbd754f-jzw6l" podStartSLOduration=10.779250369 podStartE2EDuration="13.095175647s" totalImagesPullingTime="2.315925278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:44:47.105450847 +0000 UTC m=+283.757502553" watchObservedRunningTime="2026-07-18 02:44:56.095175647 +0000 UTC m=+292.747227348"
Jul 18 02:45:03.696796 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:03.696772    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:45:03.697281 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:03.697033    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:45:03.700059 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:03.700042    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 02:45:03.857377 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:03.857348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:05.021784 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:05.021748    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:44.207685 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.207657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:44.306400 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.306370    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:44.328516 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.328486    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:44.331963 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.331943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:44.334552 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.334530    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-688n4\""
Jul 18 02:45:44.335324 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.335297    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 02:45:44.335394 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.335302    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 02:45:44.349658 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.349634    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:44.389368 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.389332    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:44.432164 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.432134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzlw6\" (UniqueName: \"kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6\") pod \"kuadrant-operator-catalog-cjm7r\" (UID: \"7d325510-75d8-451b-a86f-2e8e70cf2d73\") " pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:44.532592 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.532502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzlw6\" (UniqueName: \"kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6\") pod \"kuadrant-operator-catalog-cjm7r\" (UID: \"7d325510-75d8-451b-a86f-2e8e70cf2d73\") " pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:44.540578 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.540552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzlw6\" (UniqueName: \"kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6\") pod \"kuadrant-operator-catalog-cjm7r\" (UID: \"7d325510-75d8-451b-a86f-2e8e70cf2d73\") " pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:44.643464 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.643427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:44.699160 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.699078    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:44.779136 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.779111    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:44.781716 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:45:44.781689    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d325510_75d8_451b_a86f_2e8e70cf2d73.slice/crio-1b5eb88a05144315343a56775f528558724bfe1216aeea81f9b00ea1f8e717a6 WatchSource:0}: Error finding container 1b5eb88a05144315343a56775f528558724bfe1216aeea81f9b00ea1f8e717a6: Status 404 returned error can't find the container with id 1b5eb88a05144315343a56775f528558724bfe1216aeea81f9b00ea1f8e717a6
Jul 18 02:45:44.783172 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.783124    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:45:44.901862 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.901824    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hjcc"]
Jul 18 02:45:44.906252 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.906236    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:44.913576 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:44.913555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hjcc"]
Jul 18 02:45:45.037474 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.037382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8lp\" (UniqueName: \"kubernetes.io/projected/c0cff567-407a-41b6-a027-d0d27ac15eca-kube-api-access-9m8lp\") pod \"kuadrant-operator-catalog-2hjcc\" (UID: \"c0cff567-407a-41b6-a027-d0d27ac15eca\") " pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:45.136204 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.136164    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:45.138401 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.138378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8lp\" (UniqueName: \"kubernetes.io/projected/c0cff567-407a-41b6-a027-d0d27ac15eca-kube-api-access-9m8lp\") pod \"kuadrant-operator-catalog-2hjcc\" (UID: \"c0cff567-407a-41b6-a027-d0d27ac15eca\") " pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:45.147886 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.147865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8lp\" (UniqueName: \"kubernetes.io/projected/c0cff567-407a-41b6-a027-d0d27ac15eca-kube-api-access-9m8lp\") pod \"kuadrant-operator-catalog-2hjcc\" (UID: \"c0cff567-407a-41b6-a027-d0d27ac15eca\") " pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:45.215867 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.215841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:45.328218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.328186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" event={"ID":"7d325510-75d8-451b-a86f-2e8e70cf2d73","Type":"ContainerStarted","Data":"1b5eb88a05144315343a56775f528558724bfe1216aeea81f9b00ea1f8e717a6"}
Jul 18 02:45:45.342465 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.342435    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:45:45.360897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:45.360862    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hjcc"]
Jul 18 02:45:45.445293 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:45:45.445261    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cff567_407a_41b6_a027_d0d27ac15eca.slice/crio-e4b71d5cd26f1c6fbe904363ebd0f8799309d2c91d891871e9827ae029edef94 WatchSource:0}: Error finding container e4b71d5cd26f1c6fbe904363ebd0f8799309d2c91d891871e9827ae029edef94: Status 404 returned error can't find the container with id e4b71d5cd26f1c6fbe904363ebd0f8799309d2c91d891871e9827ae029edef94
Jul 18 02:45:46.339555 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:46.339519    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc" event={"ID":"c0cff567-407a-41b6-a027-d0d27ac15eca","Type":"ContainerStarted","Data":"e4b71d5cd26f1c6fbe904363ebd0f8799309d2c91d891871e9827ae029edef94"}
Jul 18 02:45:47.351845 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.351804    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc" event={"ID":"c0cff567-407a-41b6-a027-d0d27ac15eca","Type":"ContainerStarted","Data":"a11c93534e396e2e9f9c96603c8fa80e3ce23a1b8c6a2ba1f419b070b88fe8c0"}
Jul 18 02:45:47.353970 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.353942    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" event={"ID":"7d325510-75d8-451b-a86f-2e8e70cf2d73","Type":"ContainerStarted","Data":"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"}
Jul 18 02:45:47.354102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.354056    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" podUID="7d325510-75d8-451b-a86f-2e8e70cf2d73" containerName="registry-server" containerID="cri-o://0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5" gracePeriod=2
Jul 18 02:45:47.370768 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.370724    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc" podStartSLOduration=1.999521084 podStartE2EDuration="3.370709516s" totalImagesPullingTime="1.371188432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:45:47.369599196 +0000 UTC m=+344.021650897" watchObservedRunningTime="2026-07-18 02:45:47.370709516 +0000 UTC m=+344.022761244"
Jul 18 02:45:47.389853 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.389808    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" podStartSLOduration=1.357903286 podStartE2EDuration="3.389795037s" totalImagesPullingTime="2.031891751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:45:47.388952243 +0000 UTC m=+344.041003945" watchObservedRunningTime="2026-07-18 02:45:47.389795037 +0000 UTC m=+344.041846737"
Jul 18 02:45:47.587463 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.587438    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:47.760739 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.760692    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzlw6\" (UniqueName: \"kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6\") pod \"7d325510-75d8-451b-a86f-2e8e70cf2d73\" (UID: \"7d325510-75d8-451b-a86f-2e8e70cf2d73\") "
Jul 18 02:45:47.763056 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.763035    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6" (OuterVolumeSpecName: "kube-api-access-kzlw6") pod "7d325510-75d8-451b-a86f-2e8e70cf2d73" (UID: "7d325510-75d8-451b-a86f-2e8e70cf2d73"). InnerVolumeSpecName "kube-api-access-kzlw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:45:47.861921 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:47.861890    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzlw6\" (UniqueName: \"kubernetes.io/projected/7d325510-75d8-451b-a86f-2e8e70cf2d73-kube-api-access-kzlw6\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:45:48.358667 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.358635    2567 generic.go:356] "Generic (PLEG): container finished" podID="7d325510-75d8-451b-a86f-2e8e70cf2d73" containerID="0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5" exitCode=0
Jul 18 02:45:48.359212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.358676    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r"
Jul 18 02:45:48.359212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.358728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" event={"ID":"7d325510-75d8-451b-a86f-2e8e70cf2d73","Type":"ContainerDied","Data":"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"}
Jul 18 02:45:48.359212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.358787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cjm7r" event={"ID":"7d325510-75d8-451b-a86f-2e8e70cf2d73","Type":"ContainerDied","Data":"1b5eb88a05144315343a56775f528558724bfe1216aeea81f9b00ea1f8e717a6"}
Jul 18 02:45:48.359212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.358816    2567 scope.go:117] "RemoveContainer" containerID="0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"
Jul 18 02:45:48.367440 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.367422    2567 scope.go:117] "RemoveContainer" containerID="0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"
Jul 18 02:45:48.367709 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:45:48.367679    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5\": container with ID starting with 0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5 not found: ID does not exist" containerID="0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"
Jul 18 02:45:48.367839 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.367709    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5"} err="failed to get container status \"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5\": rpc error: code = NotFound desc = could not find container \"0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5\": container with ID starting with 0a621153a40b9a2b9ab7f5d9cd1eaca7edc9ae3249c9c26e18a3502f079fa5f5 not found: ID does not exist"
Jul 18 02:45:48.380065 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.380042    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:48.386047 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:48.386029    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cjm7r"]
Jul 18 02:45:49.773016 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:49.772966    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d325510-75d8-451b-a86f-2e8e70cf2d73" path="/var/lib/kubelet/pods/7d325510-75d8-451b-a86f-2e8e70cf2d73/volumes"
Jul 18 02:45:55.216142 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:55.216051    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:55.216142 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:55.216126    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:55.238738 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:55.238712    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:45:55.412348 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:45:55.412319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2hjcc"
Jul 18 02:46:08.329080 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:08.329032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:12.006369 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:12.006334    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:16.235125 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.235085    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"]
Jul 18 02:46:16.235620 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.235598    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d325510-75d8-451b-a86f-2e8e70cf2d73" containerName="registry-server"
Jul 18 02:46:16.235691 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.235625    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d325510-75d8-451b-a86f-2e8e70cf2d73" containerName="registry-server"
Jul 18 02:46:16.235742 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.235710    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d325510-75d8-451b-a86f-2e8e70cf2d73" containerName="registry-server"
Jul 18 02:46:16.242106 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.242085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.245069 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.245050    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mtc7r\""
Jul 18 02:46:16.265468 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.265445    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"]
Jul 18 02:46:16.274183 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.274155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjqs\" (UniqueName: \"kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.274297 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.274220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.374729 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.374694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.374920 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.374757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjqs\" (UniqueName: \"kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.375150 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.375127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.406890 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.406867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjqs\" (UniqueName: \"kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.530684 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.530602    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:16.551567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.551540    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:16.694127 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:16.694102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"]
Jul 18 02:46:16.695653 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:46:16.695627    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16c7f93_847b_40fc_94db_78c3897a6bd9.slice/crio-f2bdc8cf9e2e54c6a859c650fb025d19f51dbea08ec57def5e3859e671a2b08e WatchSource:0}: Error finding container f2bdc8cf9e2e54c6a859c650fb025d19f51dbea08ec57def5e3859e671a2b08e: Status 404 returned error can't find the container with id f2bdc8cf9e2e54c6a859c650fb025d19f51dbea08ec57def5e3859e671a2b08e
Jul 18 02:46:17.039939 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:17.039913    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:17.176115 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:17.176082    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:17.482317 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:17.482275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4" event={"ID":"a16c7f93-847b-40fc-94db-78c3897a6bd9","Type":"ContainerStarted","Data":"f2bdc8cf9e2e54c6a859c650fb025d19f51dbea08ec57def5e3859e671a2b08e"}
Jul 18 02:46:18.795291 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:18.795260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:20.930891 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:20.930843    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:21.387307 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:21.387276    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:21.493635 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:21.493556    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:22.517671 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:22.517630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4" event={"ID":"a16c7f93-847b-40fc-94db-78c3897a6bd9","Type":"ContainerStarted","Data":"21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96"}
Jul 18 02:46:22.518096 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:22.517734    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:22.538560 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:22.538507    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4" podStartSLOduration=1.359111049 podStartE2EDuration="6.538492976s" totalImagesPullingTime="5.179381927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:46:22.53680538 +0000 UTC m=+379.188857072" watchObservedRunningTime="2026-07-18 02:46:22.538492976 +0000 UTC m=+379.190544676"
Jul 18 02:46:23.377824 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:23.377798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:24.731353 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:24.731321    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:25.169658 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:25.169625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:25.268049 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:25.268016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:25.377057 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:25.377027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:28.300918 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:28.300882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:28.400959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:28.400929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:33.524005 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:33.523951    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:35.745655 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.745621    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"]
Jul 18 02:46:35.746121 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.745809    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" containerName="manager" containerID="cri-o://21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96" gracePeriod=2
Jul 18 02:46:35.773562 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.773536    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"]
Jul 18 02:46:35.781908 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:35.781876    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a16c7f93-847b-40fc-94db-78c3897a6bd9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:35.919508 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.919476    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"]
Jul 18 02:46:35.919835 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.919823    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" containerName="manager"
Jul 18 02:46:35.919877 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.919838    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" containerName="manager"
Jul 18 02:46:35.919918 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.919908    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" containerName="manager"
Jul 18 02:46:35.922796 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.922781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:35.927521 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:35.927130    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:35.927521 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.927146    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s22xd\""
Jul 18 02:46:35.962391 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.962362    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"]
Jul 18 02:46:35.987644 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:35.987625    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:36.004122 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:36.004066    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:36.043357 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.043331    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjjqs\" (UniqueName: \"kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs\") pod \"a16c7f93-847b-40fc-94db-78c3897a6bd9\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") "
Jul 18 02:46:36.043444 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.043374    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume\") pod \"a16c7f93-847b-40fc-94db-78c3897a6bd9\" (UID: \"a16c7f93-847b-40fc-94db-78c3897a6bd9\") "
Jul 18 02:46:36.043577 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.043562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ctk\" (UniqueName: \"kubernetes.io/projected/5d80a710-35f6-4f06-99cd-318d1859861e-kube-api-access-z9ctk\") pod \"limitador-operator-controller-manager-859d7b78bd-zb7wz\" (UID: \"5d80a710-35f6-4f06-99cd-318d1859861e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:36.043904 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.043884    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a16c7f93-847b-40fc-94db-78c3897a6bd9" (UID: "a16c7f93-847b-40fc-94db-78c3897a6bd9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:46:36.045582 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.045557    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs" (OuterVolumeSpecName: "kube-api-access-zjjqs") pod "a16c7f93-847b-40fc-94db-78c3897a6bd9" (UID: "a16c7f93-847b-40fc-94db-78c3897a6bd9"). InnerVolumeSpecName "kube-api-access-zjjqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:46:36.144576 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.144540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ctk\" (UniqueName: \"kubernetes.io/projected/5d80a710-35f6-4f06-99cd-318d1859861e-kube-api-access-z9ctk\") pod \"limitador-operator-controller-manager-859d7b78bd-zb7wz\" (UID: \"5d80a710-35f6-4f06-99cd-318d1859861e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:36.144746 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.144640    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjjqs\" (UniqueName: \"kubernetes.io/projected/a16c7f93-847b-40fc-94db-78c3897a6bd9-kube-api-access-zjjqs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:46:36.144746 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.144650    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16c7f93-847b-40fc-94db-78c3897a6bd9-extensions-socket-volume\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:46:36.165436 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.165407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ctk\" (UniqueName: \"kubernetes.io/projected/5d80a710-35f6-4f06-99cd-318d1859861e-kube-api-access-z9ctk\") pod \"limitador-operator-controller-manager-859d7b78bd-zb7wz\" (UID: \"5d80a710-35f6-4f06-99cd-318d1859861e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:36.234855 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.234822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:36.372960 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.372933    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"]
Jul 18 02:46:36.375580 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:46:36.375554    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d80a710_35f6_4f06_99cd_318d1859861e.slice/crio-625d1fd211c20ab12a0552ffd5350a4b85647f03b59611a5091a48184b387404 WatchSource:0}: Error finding container 625d1fd211c20ab12a0552ffd5350a4b85647f03b59611a5091a48184b387404: Status 404 returned error can't find the container with id 625d1fd211c20ab12a0552ffd5350a4b85647f03b59611a5091a48184b387404
Jul 18 02:46:36.577746 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.577665    2567 generic.go:356] "Generic (PLEG): container finished" podID="a16c7f93-847b-40fc-94db-78c3897a6bd9" containerID="21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96" exitCode=0
Jul 18 02:46:36.577746 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.577711    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:36.577956 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.577764    2567 scope.go:117] "RemoveContainer" containerID="21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96"
Jul 18 02:46:36.579254 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.579225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz" event={"ID":"5d80a710-35f6-4f06-99cd-318d1859861e","Type":"ContainerStarted","Data":"625d1fd211c20ab12a0552ffd5350a4b85647f03b59611a5091a48184b387404"}
Jul 18 02:46:36.583042 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:36.583021    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:36.586474 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.586459    2567 scope.go:117] "RemoveContainer" containerID="21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96"
Jul 18 02:46:36.586702 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:36.586685    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96\": container with ID starting with 21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96 not found: ID does not exist" containerID="21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96"
Jul 18 02:46:36.586756 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:36.586708    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96"} err="failed to get container status \"21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96\": rpc error: code = NotFound desc = could not find container \"21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96\": container with ID starting with 21eebe7c3820fa4c03d8e90a3c39510cd862974dc57b40ef476762d92a498d96 not found: ID does not exist"
Jul 18 02:46:36.589770 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:46:36.589741    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ld8s4\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ld8s4"
Jul 18 02:46:37.025493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:37.025455    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:37.184001 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:37.183965    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:37.314847 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:37.314742    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:37.773459 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:37.773426    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16c7f93-847b-40fc-94db-78c3897a6bd9" path="/var/lib/kubelet/pods/a16c7f93-847b-40fc-94db-78c3897a6bd9/volumes"
Jul 18 02:46:38.589607 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:38.589563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz" event={"ID":"5d80a710-35f6-4f06-99cd-318d1859861e","Type":"ContainerStarted","Data":"eaa6c97bc7d3e6f9c7aed87df5d6447e94c95b1432919ddc8d7f1bc01a1c9bb3"}
Jul 18 02:46:38.590087 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:38.589698    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:38.636161 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:38.636113    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz" podStartSLOduration=2.396631074 podStartE2EDuration="3.636098211s" totalImagesPullingTime="1.239467137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:46:38.632489549 +0000 UTC m=+395.284541276" watchObservedRunningTime="2026-07-18 02:46:38.636098211 +0000 UTC m=+395.288149912"
Jul 18 02:46:39.502447 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:39.502414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:39.614911 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:39.614880    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:42.083242 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:42.083206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:42.179285 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:42.179253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:42.808739 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:42.808707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:42.953247 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:42.953168    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:43.815567 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:43.815532    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:43.930463 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:43.930430    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:44.396316 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:44.396283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:44.496749 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:44.496721    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:46.425216 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:46.425183    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:46.524579 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:46.524544    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:46.752633 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:46.752554    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:46.851525 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:46.851483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:49.596138 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:49.596103    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb7wz"
Jul 18 02:46:53.131518 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:53.131486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:53.267769 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:53.267741    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:53.359105 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:53.359074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:55.944096 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:55.944062    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:56.043750 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:56.043714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:58.406715 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:58.406683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:46:58.501537 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:46:58.501505    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:08.313834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:08.313799    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:08.775587 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:08.775554    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:10.964075 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:10.964048    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:11.063947 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.063914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:11.124324 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.124278    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:11.276577 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.276496    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:47:11.283040 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.283018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.285212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.285192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 02:47:11.285315 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.285299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wr5wb\""
Jul 18 02:47:11.287903 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.287881    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:47:11.318150 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.318125    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:47:11.333366 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.333345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgsqs\" (UniqueName: \"kubernetes.io/projected/e503f6d7-e92f-415d-b38d-fa0250c2b007-kube-api-access-vgsqs\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.333481 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.333374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e503f6d7-e92f-415d-b38d-fa0250c2b007-config-file\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.433848 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.433818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgsqs\" (UniqueName: \"kubernetes.io/projected/e503f6d7-e92f-415d-b38d-fa0250c2b007-kube-api-access-vgsqs\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.433976 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.433858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e503f6d7-e92f-415d-b38d-fa0250c2b007-config-file\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.434537 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.434511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e503f6d7-e92f-415d-b38d-fa0250c2b007-config-file\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.441661 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.441634    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgsqs\" (UniqueName: \"kubernetes.io/projected/e503f6d7-e92f-415d-b38d-fa0250c2b007-kube-api-access-vgsqs\") pod \"limitador-limitador-54d6d988d5-g8lp9\" (UID: \"e503f6d7-e92f-415d-b38d-fa0250c2b007\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.594513 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.594425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:11.724173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.724015    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:47:11.726516 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:47:11.726488    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode503f6d7_e92f_415d_b38d_fa0250c2b007.slice/crio-cb3dcf9fac47a926a745448bd132e550e1df63b8231b4cbc226746f050be3237 WatchSource:0}: Error finding container cb3dcf9fac47a926a745448bd132e550e1df63b8231b4cbc226746f050be3237: Status 404 returned error can't find the container with id cb3dcf9fac47a926a745448bd132e550e1df63b8231b4cbc226746f050be3237
Jul 18 02:47:11.757200 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.757172    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:11.762850 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.762832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:11.765862 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.765735    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dn2vt\""
Jul 18 02:47:11.767752 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.767735    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:11.796878 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.796853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:11.837028 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.837000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtwr\" (UniqueName: \"kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr\") pod \"authorino-58cd955675-kj69l\" (UID: \"401c25d3-ee4c-4de2-8552-bb995ef295c3\") " pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:11.864314 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.864289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:11.937814 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.937790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtwr\" (UniqueName: \"kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr\") pod \"authorino-58cd955675-kj69l\" (UID: \"401c25d3-ee4c-4de2-8552-bb995ef295c3\") " pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:11.949477 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:11.949451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtwr\" (UniqueName: \"kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr\") pod \"authorino-58cd955675-kj69l\" (UID: \"401c25d3-ee4c-4de2-8552-bb995ef295c3\") " pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:12.073273 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:12.073245    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:12.199001 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:12.198955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:12.201572 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:47:12.201537    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod401c25d3_ee4c_4de2_8552_bb995ef295c3.slice/crio-897c1e20862de07f9d0d0649bd492a391676d51ddb7a3b8fe8f16a3bc15597ff WatchSource:0}: Error finding container 897c1e20862de07f9d0d0649bd492a391676d51ddb7a3b8fe8f16a3bc15597ff: Status 404 returned error can't find the container with id 897c1e20862de07f9d0d0649bd492a391676d51ddb7a3b8fe8f16a3bc15597ff
Jul 18 02:47:12.734840 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:12.734797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kj69l" event={"ID":"401c25d3-ee4c-4de2-8552-bb995ef295c3","Type":"ContainerStarted","Data":"897c1e20862de07f9d0d0649bd492a391676d51ddb7a3b8fe8f16a3bc15597ff"}
Jul 18 02:47:12.736173 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:12.736136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9" event={"ID":"e503f6d7-e92f-415d-b38d-fa0250c2b007","Type":"ContainerStarted","Data":"cb3dcf9fac47a926a745448bd132e550e1df63b8231b4cbc226746f050be3237"}
Jul 18 02:47:15.956071 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:15.956014    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:16.756145 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.756102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kj69l" event={"ID":"401c25d3-ee4c-4de2-8552-bb995ef295c3","Type":"ContainerStarted","Data":"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"}
Jul 18 02:47:16.756391 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.756153    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kj69l" podUID="401c25d3-ee4c-4de2-8552-bb995ef295c3" containerName="authorino" containerID="cri-o://3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3" gracePeriod=30
Jul 18 02:47:16.757815 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.757787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9" event={"ID":"e503f6d7-e92f-415d-b38d-fa0250c2b007","Type":"ContainerStarted","Data":"7c8e3414ed6f8462df8addf4521a161a9649158a2a3b319fbb530d911ee05435"}
Jul 18 02:47:16.757929 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.757838    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:16.771386 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.771347    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kj69l" podStartSLOduration=1.837652951 podStartE2EDuration="5.771334497s" totalImagesPullingTime="3.933681546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:47:16.770295082 +0000 UTC m=+433.422346784" watchObservedRunningTime="2026-07-18 02:47:16.771334497 +0000 UTC m=+433.423386197"
Jul 18 02:47:16.785689 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:16.785651    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9" podStartSLOduration=1.339200039 podStartE2EDuration="5.785638478s" totalImagesPullingTime="4.446438439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:47:16.784979082 +0000 UTC m=+433.437030786" watchObservedRunningTime="2026-07-18 02:47:16.785638478 +0000 UTC m=+433.437690178"
Jul 18 02:47:17.005207 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.005176    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:17.085135 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.085051    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqtwr\" (UniqueName: \"kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr\") pod \"401c25d3-ee4c-4de2-8552-bb995ef295c3\" (UID: \"401c25d3-ee4c-4de2-8552-bb995ef295c3\") "
Jul 18 02:47:17.087218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.087194    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr" (OuterVolumeSpecName: "kube-api-access-lqtwr") pod "401c25d3-ee4c-4de2-8552-bb995ef295c3" (UID: "401c25d3-ee4c-4de2-8552-bb995ef295c3"). InnerVolumeSpecName "kube-api-access-lqtwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:47:17.186099 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.186068    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqtwr\" (UniqueName: \"kubernetes.io/projected/401c25d3-ee4c-4de2-8552-bb995ef295c3-kube-api-access-lqtwr\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:47:17.763975 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.763932    2567 generic.go:356] "Generic (PLEG): container finished" podID="401c25d3-ee4c-4de2-8552-bb995ef295c3" containerID="3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3" exitCode=0
Jul 18 02:47:17.764174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.764016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kj69l"
Jul 18 02:47:17.764174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.764035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kj69l" event={"ID":"401c25d3-ee4c-4de2-8552-bb995ef295c3","Type":"ContainerDied","Data":"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"}
Jul 18 02:47:17.764174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.764086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kj69l" event={"ID":"401c25d3-ee4c-4de2-8552-bb995ef295c3","Type":"ContainerDied","Data":"897c1e20862de07f9d0d0649bd492a391676d51ddb7a3b8fe8f16a3bc15597ff"}
Jul 18 02:47:17.764174 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.764104    2567 scope.go:117] "RemoveContainer" containerID="3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"
Jul 18 02:47:17.773371 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.773358    2567 scope.go:117] "RemoveContainer" containerID="3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"
Jul 18 02:47:17.773577 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:47:17.773561    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3\": container with ID starting with 3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3 not found: ID does not exist" containerID="3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"
Jul 18 02:47:17.773617 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.773584    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3"} err="failed to get container status \"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3\": rpc error: code = NotFound desc = could not find container \"3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3\": container with ID starting with 3d4d8dd771075b406ae37541ed801a7c65821064298a78e9ce8626d14559b8e3 not found: ID does not exist"
Jul 18 02:47:17.786414 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.786387    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:17.791944 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:17.791923    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kj69l"]
Jul 18 02:47:19.773959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:19.773925    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401c25d3-ee4c-4de2-8552-bb995ef295c3" path="/var/lib/kubelet/pods/401c25d3-ee4c-4de2-8552-bb995ef295c3/volumes"
Jul 18 02:47:27.765091 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:27.765010    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"
Jul 18 02:47:32.157569 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:32.157535    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:32.256925 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:32.256896    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:32.692516 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:32.692483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:34.682577 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:34.682546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:44.410564 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.410524    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:44.639575 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.639543    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xffxp"]
Jul 18 02:47:44.639937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.639921    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401c25d3-ee4c-4de2-8552-bb995ef295c3" containerName="authorino"
Jul 18 02:47:44.639937 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.639938    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="401c25d3-ee4c-4de2-8552-bb995ef295c3" containerName="authorino"
Jul 18 02:47:44.640055 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.640026    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="401c25d3-ee4c-4de2-8552-bb995ef295c3" containerName="authorino"
Jul 18 02:47:44.645668 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.645650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.648193 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.648147    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dn2vt\""
Jul 18 02:47:44.649853 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.649834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xffxp"]
Jul 18 02:47:44.690445 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.690389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:44.722480 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.722455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd5rk\" (UniqueName: \"kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk\") pod \"authorino-5d4b67c446-xffxp\" (UID: \"c56ced4e-7531-498b-83bf-113cf465a3f8\") " pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.823369 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.823338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5rk\" (UniqueName: \"kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk\") pod \"authorino-5d4b67c446-xffxp\" (UID: \"c56ced4e-7531-498b-83bf-113cf465a3f8\") " pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.824766 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.824747    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xffxp"]
Jul 18 02:47:44.824957 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:47:44.824940    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kd5rk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-xffxp" podUID="c56ced4e-7531-498b-83bf-113cf465a3f8"
Jul 18 02:47:44.835897 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.835871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd5rk\" (UniqueName: \"kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk\") pod \"authorino-5d4b67c446-xffxp\" (UID: \"c56ced4e-7531-498b-83bf-113cf465a3f8\") " pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.853310 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.853275    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-qw7fk"]
Jul 18 02:47:44.856974 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.856955    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:44.859351 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.859334    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 02:47:44.865213 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.865193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-qw7fk"]
Jul 18 02:47:44.880357 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.880335    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.887036 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.887017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:44.904350 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.904327    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qw7fk"]
Jul 18 02:47:44.904572 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:47:44.904554    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q8qnz tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-q8qnz tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-qw7fk" podUID="83e4eca5-e0e2-4d1d-bd3a-f259ad186c32"
Jul 18 02:47:44.932134 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.932108    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:47:44.935724 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.935705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:44.943500 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:44.943477    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:47:45.025167 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.025129    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd5rk\" (UniqueName: \"kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk\") pod \"c56ced4e-7531-498b-83bf-113cf465a3f8\" (UID: \"c56ced4e-7531-498b-83bf-113cf465a3f8\") "
Jul 18 02:47:45.025357 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.025334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.025435 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.025378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.025435 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.025413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8qnz\" (UniqueName: \"kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.025525 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.025447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-476w2\" (UniqueName: \"kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.027339 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.027318    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk" (OuterVolumeSpecName: "kube-api-access-kd5rk") pod "c56ced4e-7531-498b-83bf-113cf465a3f8" (UID: "c56ced4e-7531-498b-83bf-113cf465a3f8"). InnerVolumeSpecName "kube-api-access-kd5rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:47:45.126434 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.126390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.126434 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.126438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8qnz\" (UniqueName: \"kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.126698 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.126469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-476w2\" (UniqueName: \"kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.126698 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.126560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.126698 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.126596    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd5rk\" (UniqueName: \"kubernetes.io/projected/c56ced4e-7531-498b-83bf-113cf465a3f8-kube-api-access-kd5rk\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:47:45.129114 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.129091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.129213 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.129198    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.134535 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.134514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-476w2\" (UniqueName: \"kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2\") pod \"authorino-c64657d46-nbvhf\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") " pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.134842 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.134821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8qnz\" (UniqueName: \"kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz\") pod \"authorino-76877994-qw7fk\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") " pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.245395 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.245326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:47:45.379258 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.379203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:47:45.382001 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:47:45.381960    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b75c6ad_eae7_4b63_b7c5_f4bd291be7d3.slice/crio-2278edecff805af6d733c20c9a0529350f6f153c04f23a97c493fba97e644419 WatchSource:0}: Error finding container 2278edecff805af6d733c20c9a0529350f6f153c04f23a97c493fba97e644419: Status 404 returned error can't find the container with id 2278edecff805af6d733c20c9a0529350f6f153c04f23a97c493fba97e644419
Jul 18 02:47:45.885795 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.885766    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.886195 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.885799    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c64657d46-nbvhf" event={"ID":"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3","Type":"ContainerStarted","Data":"2278edecff805af6d733c20c9a0529350f6f153c04f23a97c493fba97e644419"}
Jul 18 02:47:45.886195 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.885924    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xffxp"
Jul 18 02:47:45.916100 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.916083    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:45.935192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.935167    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xffxp"]
Jul 18 02:47:45.939834 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:45.939804    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xffxp"]
Jul 18 02:47:46.032816 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.032766    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8qnz\" (UniqueName: \"kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz\") pod \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") "
Jul 18 02:47:46.032917 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.032850    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert\") pod \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\" (UID: \"83e4eca5-e0e2-4d1d-bd3a-f259ad186c32\") "
Jul 18 02:47:46.034719 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.034692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz" (OuterVolumeSpecName: "kube-api-access-q8qnz") pod "83e4eca5-e0e2-4d1d-bd3a-f259ad186c32" (UID: "83e4eca5-e0e2-4d1d-bd3a-f259ad186c32"). InnerVolumeSpecName "kube-api-access-q8qnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:47:46.034899 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.034879    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "83e4eca5-e0e2-4d1d-bd3a-f259ad186c32" (UID: "83e4eca5-e0e2-4d1d-bd3a-f259ad186c32"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:47:46.134049 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.134012    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8qnz\" (UniqueName: \"kubernetes.io/projected/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-kube-api-access-q8qnz\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:47:46.134049 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.134045    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32-tls-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:47:46.897612 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.897582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qw7fk"
Jul 18 02:47:46.898102 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.897615    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c64657d46-nbvhf" event={"ID":"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3","Type":"ContainerStarted","Data":"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"}
Jul 18 02:47:46.913416 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.913375    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c64657d46-nbvhf" podStartSLOduration=2.345563572 podStartE2EDuration="2.913359863s" totalImagesPullingTime="567.796291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:47:46.912238105 +0000 UTC m=+463.564289807" watchObservedRunningTime="2026-07-18 02:47:46.913359863 +0000 UTC m=+463.565411564"
Jul 18 02:47:46.939111 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.939079    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qw7fk"]
Jul 18 02:47:46.945095 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:46.945067    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-qw7fk"]
Jul 18 02:47:47.774733 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:47.774701    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e4eca5-e0e2-4d1d-bd3a-f259ad186c32" path="/var/lib/kubelet/pods/83e4eca5-e0e2-4d1d-bd3a-f259ad186c32/volumes"
Jul 18 02:47:47.774966 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:47.774912    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56ced4e-7531-498b-83bf-113cf465a3f8" path="/var/lib/kubelet/pods/c56ced4e-7531-498b-83bf-113cf465a3f8/volumes"
Jul 18 02:47:51.638303 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:51.638271    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:51.704453 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:51.704405    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:51.760610 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:51.760585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:51.857776 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:51.857749    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:54.740497 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:54.740457    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:47:54.882063 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:47:54.882035    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:01.041932 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:01.041899    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:26.460309 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:26.460276    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:26.557039 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:26.557007    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:27.008957 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:27.008922    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:27.407711 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:27.407671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:27.500108 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:27.500060    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:27.604185 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:27.604146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:27.611533 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:27.611496    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:48:35.076215 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:35.076186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:35.137225 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:35.137196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:37.960252 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:37.960209    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:38.060247 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:38.060205    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:49.135227 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:49.135193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:49.687645 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:49.687605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:48:57.100866 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:57.100792    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:48:57.886710 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:48:57.886671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:49:17.125481 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:17.125450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:18.183216 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:18.183185    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:49:22.879456 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:22.879427    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:24.486588 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:24.486547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:49:34.206136 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:34.206103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:34.262827 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:34.262785    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:36.780107 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:36.780080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:38.590308 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:38.590277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:49:57.185782 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.185749    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"]
Jul 18 02:49:57.189050 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.189028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.191589 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.191567    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 02:49:57.192526 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.192499    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 18 02:49:57.192627 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.192509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j4nw7\""
Jul 18 02:49:57.192627 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.192554    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 02:49:57.199086 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.199065    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"]
Jul 18 02:49:57.220455 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.220425    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:49:57.291129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.291129 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.291332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.291332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jp7s\" (UniqueName: \"kubernetes.io/projected/e6910ac5-b337-40b5-b139-8baa670341fb-kube-api-access-5jp7s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.291332 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6910ac5-b337-40b5-b139-8baa670341fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.291428 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.291355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392404 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jp7s\" (UniqueName: \"kubernetes.io/projected/e6910ac5-b337-40b5-b139-8baa670341fb-kube-api-access-5jp7s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392599 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6910ac5-b337-40b5-b139-8baa670341fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392599 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392599 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392592    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392758 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392758 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392668    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392840 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392789    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.392959 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.392936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.393085 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.393066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.394914 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.394891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6910ac5-b337-40b5-b139-8baa670341fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.395078 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.395060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6910ac5-b337-40b5-b139-8baa670341fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.400939 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.400916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jp7s\" (UniqueName: \"kubernetes.io/projected/e6910ac5-b337-40b5-b139-8baa670341fb-kube-api-access-5jp7s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8\" (UID: \"e6910ac5-b337-40b5-b139-8baa670341fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.499156 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.499056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:49:57.632204 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:57.632147    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"]
Jul 18 02:49:57.634507 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:49:57.634483    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6910ac5_b337_40b5_b139_8baa670341fb.slice/crio-7535e17cb9f6f4146013ed0f52ca0b192bf8492f81f38bfd39629d1cd981b655 WatchSource:0}: Error finding container 7535e17cb9f6f4146013ed0f52ca0b192bf8492f81f38bfd39629d1cd981b655: Status 404 returned error can't find the container with id 7535e17cb9f6f4146013ed0f52ca0b192bf8492f81f38bfd39629d1cd981b655
Jul 18 02:49:58.475626 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:58.475582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8" event={"ID":"e6910ac5-b337-40b5-b139-8baa670341fb","Type":"ContainerStarted","Data":"7535e17cb9f6f4146013ed0f52ca0b192bf8492f81f38bfd39629d1cd981b655"}
Jul 18 02:49:59.389149 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:59.389115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:49:59.482668 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:49:59.482640    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8" event={"ID":"e6910ac5-b337-40b5-b139-8baa670341fb","Type":"ContainerStarted","Data":"94c2f15f0c3431a7df53b565f66f38e8c1cb0e70d189c0eca5d38fc520bb04dc"}
Jul 18 02:50:03.726507 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:03.726467    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:50:03.726968 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:03.726955    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:50:07.499871 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:07.499831    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:50:07.502380 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:07.499919    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:50:07.512234 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:07.512213    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:50:07.526870 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:07.526839    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8"
Jul 18 02:50:07.532783 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:07.532742    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8" podStartSLOduration=9.548422397 podStartE2EDuration="10.532728827s" totalImagesPullingTime="984.30643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:49:59.500470694 +0000 UTC m=+596.152522393" watchObservedRunningTime="2026-07-18 02:50:07.532728827 +0000 UTC m=+604.184780505"
Jul 18 02:50:59.462960 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.462926    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6df88c55f9-dpd42"]
Jul 18 02:50:59.466386 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.466368    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.475565 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.475542    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df88c55f9-dpd42"]
Jul 18 02:50:59.519614 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.519579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frnm2\" (UniqueName: \"kubernetes.io/projected/197ea5f2-b880-4812-a482-429f7fc08e6b-kube-api-access-frnm2\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.519614 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.519611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/197ea5f2-b880-4812-a482-429f7fc08e6b-tls-cert\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.620740 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.620703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frnm2\" (UniqueName: \"kubernetes.io/projected/197ea5f2-b880-4812-a482-429f7fc08e6b-kube-api-access-frnm2\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.620740 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.620739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/197ea5f2-b880-4812-a482-429f7fc08e6b-tls-cert\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.623314 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.623291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/197ea5f2-b880-4812-a482-429f7fc08e6b-tls-cert\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.629547 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.629522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frnm2\" (UniqueName: \"kubernetes.io/projected/197ea5f2-b880-4812-a482-429f7fc08e6b-kube-api-access-frnm2\") pod \"authorino-6df88c55f9-dpd42\" (UID: \"197ea5f2-b880-4812-a482-429f7fc08e6b\") " pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.775762 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.775684    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df88c55f9-dpd42"
Jul 18 02:50:59.906708 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.906621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df88c55f9-dpd42"]
Jul 18 02:50:59.909025 ip-10-0-136-56 kubenswrapper[2567]: W0718 02:50:59.908963    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod197ea5f2_b880_4812_a482_429f7fc08e6b.slice/crio-47c3e8cad0f2a55b75bf7d03286073227ec2ad4a4772bd904362c445162db0ad WatchSource:0}: Error finding container 47c3e8cad0f2a55b75bf7d03286073227ec2ad4a4772bd904362c445162db0ad: Status 404 returned error can't find the container with id 47c3e8cad0f2a55b75bf7d03286073227ec2ad4a4772bd904362c445162db0ad
Jul 18 02:50:59.910327 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:50:59.910307    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:51:00.752998 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:00.752941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df88c55f9-dpd42" event={"ID":"197ea5f2-b880-4812-a482-429f7fc08e6b","Type":"ContainerStarted","Data":"bdf1567aba6d56fa900b7805e01cb4b8b129ccf3d1fc59c66684615dfb2d2a19"}
Jul 18 02:51:00.753545 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:00.753521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df88c55f9-dpd42" event={"ID":"197ea5f2-b880-4812-a482-429f7fc08e6b","Type":"ContainerStarted","Data":"47c3e8cad0f2a55b75bf7d03286073227ec2ad4a4772bd904362c445162db0ad"}
Jul 18 02:51:00.796913 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:00.796852    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6df88c55f9-dpd42" podStartSLOduration=1.36433001 podStartE2EDuration="1.79682823s" totalImagesPullingTime="432.49822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:51:00.773615953 +0000 UTC m=+657.425667655" watchObservedRunningTime="2026-07-18 02:51:00.79682823 +0000 UTC m=+657.448879932"
Jul 18 02:51:00.798299 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:00.798274    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:51:00.798505 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:00.798483    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c64657d46-nbvhf" podUID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" containerName="authorino" containerID="cri-o://c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d" gracePeriod=30
Jul 18 02:51:01.066863 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.066838    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:51:01.131875 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.131847    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-476w2\" (UniqueName: \"kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2\") pod \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") "
Jul 18 02:51:01.132087 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.131884    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert\") pod \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\" (UID: \"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3\") "
Jul 18 02:51:01.134127 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.134099    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2" (OuterVolumeSpecName: "kube-api-access-476w2") pod "3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" (UID: "3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3"). InnerVolumeSpecName "kube-api-access-476w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:51:01.143554 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.143528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" (UID: "3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:51:01.232923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.232885    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-476w2\" (UniqueName: \"kubernetes.io/projected/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-kube-api-access-476w2\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:51:01.232923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.232917    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3-tls-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 02:51:01.379939 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.379910    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:51:01.764592 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.762580    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" containerID="c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d" exitCode=0
Jul 18 02:51:01.764592 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.763198    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c64657d46-nbvhf"
Jul 18 02:51:01.771640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.770965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c64657d46-nbvhf" event={"ID":"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3","Type":"ContainerDied","Data":"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"}
Jul 18 02:51:01.771640 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.771116    2567 scope.go:117] "RemoveContainer" containerID="c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"
Jul 18 02:51:01.784661 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.784629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c64657d46-nbvhf" event={"ID":"3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3","Type":"ContainerDied","Data":"2278edecff805af6d733c20c9a0529350f6f153c04f23a97c493fba97e644419"}
Jul 18 02:51:01.789416 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.789396    2567 scope.go:117] "RemoveContainer" containerID="c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"
Jul 18 02:51:01.789698 ip-10-0-136-56 kubenswrapper[2567]: E0718 02:51:01.789677    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d\": container with ID starting with c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d not found: ID does not exist" containerID="c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"
Jul 18 02:51:01.789770 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.789708    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d"} err="failed to get container status \"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d\": rpc error: code = NotFound desc = could not find container \"c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d\": container with ID starting with c42cd0ce6e5d48c7ff119cdd4a7d3ad38a896dbe0cf88b1da5be34fa0cddc59d not found: ID does not exist"
Jul 18 02:51:01.797088 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.797063    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:51:01.800218 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:01.800195    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c64657d46-nbvhf"]
Jul 18 02:51:02.620679 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:02.620646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:51:03.773436 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:03.773410    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" path="/var/lib/kubelet/pods/3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3/volumes"
Jul 18 02:51:30.596114 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:30.596071    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:51:42.081201 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:42.081163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:51:54.088604 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:51:54.088569    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:52:03.754064 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:52:03.753963    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:52:04.437183 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:52:04.437148    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:03.840387 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:03.840312    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:03.900126 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:03.900094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:09.031411 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:09.031373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:09.104192 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:09.104153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:09.286278 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:09.286187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:10.521084 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:10.521047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:31.090800 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:31.090699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:53:41.287890 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:41.287851    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:53:49.120320 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:49.120261    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:49.216618 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:49.216587    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:49.343769 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:49.343733    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:55.263755 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:55.263710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:55.377080 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:55.377051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:55.465416 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:55.465384    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:53:55.635493 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:53:55.635465    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:54:01.244873 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:01.244835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:54:01.344929 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:01.344901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:54:18.384831 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:18.384798    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:54:27.685212 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:27.685175    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:54:36.483923 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:36.483884    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:54:45.288324 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:45.288284    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:54:54.984528 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:54:54.984431    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:55:00.421952 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:00.421919    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 02:55:03.751329 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:03.751297    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:55:03.753535 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:03.753516    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 02:55:05.994393 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:05.994357    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:55:16.886442 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:16.886404    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:55:26.705319 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:26.705283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:55:48.196399 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:48.196365    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:55:56.690295 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:55:56.690263    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:56:24.711698 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:56:24.711588    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:56:34.400359 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:56:34.400322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:56:50.400394 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:56:50.400355    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:57:01.596210 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:57:01.596175    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:57:10.708620 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:57:10.708582    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:57:19.689630 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:57:19.689586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:57:28.913877 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:57:28.913838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:59:17.597513 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:59:17.597477    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:59:28.901253 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:59:28.901171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:59:38.594594 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:59:38.594559    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:59:49.205399 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:59:49.205360    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 02:59:59.996411 ip-10-0-136-56 kubenswrapper[2567]: I0718 02:59:59.996376    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:00:03.780002 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:03.779961    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:00:03.782894 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:03.782873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:00:10.194580 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:10.194540    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:00:20.594379 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:20.594342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:00:31.085596 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:31.085561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:00:41.486795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:41.486762    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:00:51.119676 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:00:51.119640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:01:02.996419 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:02.996342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:01:18.656453 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:18.656417    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:01:26.222702 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:26.222664    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:01:33.499082 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:33.499039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:01:42.983674 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:42.983643    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:01:54.582715 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:01:54.582674    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:02.187160 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:02.187127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:13.700860 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:13.700821    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:16.105587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:16.105545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:02:16.173671 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:16.173640    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:02:24.382569 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:24.382530    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:33.416532 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:33.416498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:43.504111 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:43.504080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:02:44.782183 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:44.782145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:02:54.281939 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:02:54.281907    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:03.180663 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:03.180623    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:16.782528 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:16.782492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:25.583412 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:25.583376    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:34.993956 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:34.993907    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:44.685192 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:44.685141    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:03:57.477178 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:03:57.477086    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:04:04.890523 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:04.890485    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:04:17.193374 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:17.193340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:04:31.284290 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:31.284255    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:04:44.582858 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:44.582825    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:04:45.577222 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:45.577179    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:04:54.276136 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:54.276104    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:04:55.791027 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:04:55.790975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:05:01.344937 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:01.344904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:03.805354 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:03.805328    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:05:03.809688 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:03.809669    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:05:06.463699 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:06.463664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:09.477918 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:09.477883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:09.578455 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:09.578428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:09.583219 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:09.583195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:05:09.941759 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:09.941731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:15.755556 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:15.755527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:15.856181 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:15.856154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:16.022550 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:16.022467    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:16.341345 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:16.341266    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:16.455774 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:16.455749    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:19.069162 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:19.069129    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:19.146451 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:19.146420    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:19.343285 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:19.343138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:19.679638 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:19.679586    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:19.816960 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:19.816926    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:22.783997 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:22.783958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:05:44.614886 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.614847    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"]
Jul 18 03:05:44.615363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.615223    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" containerName="authorino"
Jul 18 03:05:44.615363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.615235    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" containerName="authorino"
Jul 18 03:05:44.615363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.615303    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b75c6ad-eae7-4b63-b7c5-f4bd291be7d3" containerName="authorino"
Jul 18 03:05:44.618171 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.618154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:44.620485 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.620461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:05:44.620600 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.620483    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:05:44.624526 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.624197    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"]
Jul 18 03:05:44.710075 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.710039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj\" (UID: \"099d0b78-eec3-4dc3-8c55-285b786f0f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:44.810779 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.810739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj\" (UID: \"099d0b78-eec3-4dc3-8c55-285b786f0f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:44.811361 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.811341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj\" (UID: \"099d0b78-eec3-4dc3-8c55-285b786f0f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:44.929402 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:44.929327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:45.058202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:45.058178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"]
Jul 18 03:05:45.060804 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:05:45.060780    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099d0b78_eec3_4dc3_8c55_285b786f0f61.slice/crio-db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854 WatchSource:0}: Error finding container db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854: Status 404 returned error can't find the container with id db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854
Jul 18 03:05:45.063024 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:45.063011    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 03:05:45.685912 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:45.685876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj" event={"ID":"099d0b78-eec3-4dc3-8c55-285b786f0f61","Type":"ContainerStarted","Data":"db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854"}
Jul 18 03:05:47.696128 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:47.696095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj" event={"ID":"099d0b78-eec3-4dc3-8c55-285b786f0f61","Type":"ContainerStarted","Data":"568e8eb42f01f90ee30d7e1b76c69d1f85aebd13163188f5ffeed4011ac88b2b"}
Jul 18 03:05:47.711370 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:47.711329    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj" podStartSLOduration=1.421682327 podStartE2EDuration="3.71131591s" totalImagesPullingTime="2.289633583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:05:47.709999253 +0000 UTC m=+1544.362050947" watchObservedRunningTime="2026-07-18 03:05:47.71131591 +0000 UTC m=+1544.363367610"
Jul 18 03:05:48.702030 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:48.701972    2567 generic.go:356] "Generic (PLEG): container finished" podID="099d0b78-eec3-4dc3-8c55-285b786f0f61" containerID="568e8eb42f01f90ee30d7e1b76c69d1f85aebd13163188f5ffeed4011ac88b2b" exitCode=0
Jul 18 03:05:48.702407 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:48.702051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj" event={"ID":"099d0b78-eec3-4dc3-8c55-285b786f0f61","Type":"ContainerDied","Data":"568e8eb42f01f90ee30d7e1b76c69d1f85aebd13163188f5ffeed4011ac88b2b"}
Jul 18 03:05:49.831698 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:49.831675    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:49.959143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:49.959064    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca\") pod \"099d0b78-eec3-4dc3-8c55-285b786f0f61\" (UID: \"099d0b78-eec3-4dc3-8c55-285b786f0f61\") "
Jul 18 03:05:49.959412 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:49.959391    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "099d0b78-eec3-4dc3-8c55-285b786f0f61" (UID: "099d0b78-eec3-4dc3-8c55-285b786f0f61"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:05:50.060572 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:50.060545    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/099d0b78-eec3-4dc3-8c55-285b786f0f61-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:05:50.711470 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:50.711438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj" event={"ID":"099d0b78-eec3-4dc3-8c55-285b786f0f61","Type":"ContainerDied","Data":"db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854"}
Jul 18 03:05:50.711470 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:50.711453    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"
Jul 18 03:05:50.711676 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:50.711485    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db2224266a11f07e4c94f7641fd48c939a87b04b6320abebf0ad32cb7c307854"
Jul 18 03:05:55.164742 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:55.164710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:57.986186 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:57.986146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:05:59.686478 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:59.686446    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"]
Jul 18 03:05:59.688278 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:59.688250    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-43e0ec51-6czgj"]
Jul 18 03:05:59.688821 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:59.688800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:05:59.773958 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:59.773920    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="099d0b78-eec3-4dc3-8c55-285b786f0f61" path="/var/lib/kubelet/pods/099d0b78-eec3-4dc3-8c55-285b786f0f61/volumes"
Jul 18 03:05:59.856188 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:05:59.856159    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:00.100728 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:00.100621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:00.338246 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:00.338181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:00.783815 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:00.783781    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:00.875041 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:00.875014    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:01.038488 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:01.038389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:01.132631 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:01.132596    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:03.406715 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:03.406683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:03.620413 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:03.620382    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:03.694477 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:03.694397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:04.106625 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:04.106593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:04.204478 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:04.204444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:09.379599 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:09.379558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:06:21.672130 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:21.672093    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:28.420361 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.420327    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"]
Jul 18 03:06:28.420864 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.420844    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="099d0b78-eec3-4dc3-8c55-285b786f0f61" containerName="revoke-keys"
Jul 18 03:06:28.420940 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.420868    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="099d0b78-eec3-4dc3-8c55-285b786f0f61" containerName="revoke-keys"
Jul 18 03:06:28.421028 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.420956    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="099d0b78-eec3-4dc3-8c55-285b786f0f61" containerName="revoke-keys"
Jul 18 03:06:28.428958 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.428927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:28.430776 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.430750    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"]
Jul 18 03:06:28.431418 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.431190    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:06:28.431418 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.431206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:06:28.484719 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.484684    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h\" (UID: \"79cc6b99-9ae4-4923-98fa-3f2698503f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:28.585907 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.585875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h\" (UID: \"79cc6b99-9ae4-4923-98fa-3f2698503f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:28.586452 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.586434    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h\" (UID: \"79cc6b99-9ae4-4923-98fa-3f2698503f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:28.742202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.742126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:28.878048 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:28.878017    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"]
Jul 18 03:06:28.881227 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:06:28.881204    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cc6b99_9ae4_4923_98fa_3f2698503f41.slice/crio-645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0 WatchSource:0}: Error finding container 645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0: Status 404 returned error can't find the container with id 645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0
Jul 18 03:06:29.885427 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:29.885394    2567 generic.go:356] "Generic (PLEG): container finished" podID="79cc6b99-9ae4-4923-98fa-3f2698503f41" containerID="d82cda11e7ba3b821f1ded4927115840a34fee88f9ef8240fae9719fee577a2e" exitCode=0
Jul 18 03:06:29.885839 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:29.885463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h" event={"ID":"79cc6b99-9ae4-4923-98fa-3f2698503f41","Type":"ContainerDied","Data":"d82cda11e7ba3b821f1ded4927115840a34fee88f9ef8240fae9719fee577a2e"}
Jul 18 03:06:29.885839 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:29.885514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h" event={"ID":"79cc6b99-9ae4-4923-98fa-3f2698503f41","Type":"ContainerStarted","Data":"645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0"}
Jul 18 03:06:31.032890 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.032860    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:31.108722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.108687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca\") pod \"79cc6b99-9ae4-4923-98fa-3f2698503f41\" (UID: \"79cc6b99-9ae4-4923-98fa-3f2698503f41\") "
Jul 18 03:06:31.109102 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.109079    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79cc6b99-9ae4-4923-98fa-3f2698503f41" (UID: "79cc6b99-9ae4-4923-98fa-3f2698503f41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:06:31.210038 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.209919    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79cc6b99-9ae4-4923-98fa-3f2698503f41-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:06:31.896240 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.896213    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"
Jul 18 03:06:31.896436 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.896208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h" event={"ID":"79cc6b99-9ae4-4923-98fa-3f2698503f41","Type":"ContainerDied","Data":"645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0"}
Jul 18 03:06:31.896436 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:31.896342    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="645c573e20f86e99baa8c8e5734d6dfa0406aea799107968b64e0590075ab9a0"
Jul 18 03:06:38.818467 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:38.818405    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:41.782798 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:41.782763    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:06:43.487457 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.487425    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"]
Jul 18 03:06:43.488955 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.488932    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a70f0b50-dhh6h"]
Jul 18 03:06:43.491864 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.491843    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:43.639583 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.639557    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:43.774312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.774232    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cc6b99-9ae4-4923-98fa-3f2698503f41" path="/var/lib/kubelet/pods/79cc6b99-9ae4-4923-98fa-3f2698503f41/volumes"
Jul 18 03:06:43.872678 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:43.872648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:44.108632 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:44.108603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:44.442715 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:44.442646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:44.558293 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:44.558262    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:46.557953 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:46.557919    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:46.654629 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:46.654596    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:46.784874 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:46.784845    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:47.111571 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:47.111537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:47.303931 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:47.303896    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:47.405238 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:47.405155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:06:53.089870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:06:53.089833    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:07:12.360812 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.360778    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"]
Jul 18 03:07:12.361221 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.361158    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cc6b99-9ae4-4923-98fa-3f2698503f41" containerName="revoke-keys"
Jul 18 03:07:12.361221 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.361173    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cc6b99-9ae4-4923-98fa-3f2698503f41" containerName="revoke-keys"
Jul 18 03:07:12.361292 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.361251    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cc6b99-9ae4-4923-98fa-3f2698503f41" containerName="revoke-keys"
Jul 18 03:07:12.364248 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.364231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:12.366443 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.366421    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:07:12.366563 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.366421    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:07:12.370132 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.370102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"]
Jul 18 03:07:12.464887 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.464844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr\" (UID: \"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:12.566281 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.566248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr\" (UID: \"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:12.566890 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.566870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr\" (UID: \"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:12.675624 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.675536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:12.813087 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:12.813054    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"]
Jul 18 03:07:12.817028 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:07:12.816999    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94c61b7_75b1_4ecf_a80b_019eb8f4cbe9.slice/crio-04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b WatchSource:0}: Error finding container 04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b: Status 404 returned error can't find the container with id 04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b
Jul 18 03:07:13.079044 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:13.079012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr" event={"ID":"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9","Type":"ContainerStarted","Data":"04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b"}
Jul 18 03:07:14.084722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:14.084683    2567 generic.go:356] "Generic (PLEG): container finished" podID="c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" containerID="9e167c7d05352407e42b1b801b7003119f35d22b7f33e8dd7d8da3dc578b2700" exitCode=0
Jul 18 03:07:14.085123 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:14.084741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr" event={"ID":"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9","Type":"ContainerDied","Data":"9e167c7d05352407e42b1b801b7003119f35d22b7f33e8dd7d8da3dc578b2700"}
Jul 18 03:07:14.239279 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:14.239243    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:14.338850 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:14.338765    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:15.217909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:15.217883    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:15.289968 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:15.289932    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca\") pod \"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9\" (UID: \"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9\") "
Jul 18 03:07:15.290323 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:15.290301    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" (UID: "c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:07:15.390879 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:15.390849    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:07:16.094400 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:16.094320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"
Jul 18 03:07:16.094400 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:16.094349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr" event={"ID":"c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9","Type":"ContainerDied","Data":"04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b"}
Jul 18 03:07:16.094400 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:16.094390    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04ac72fb67131079e2fdfdfb41a1088e2ae84a876247492d00d70df121c89a7b"
Jul 18 03:07:22.741427 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:22.741393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:25.787115 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:25.787082    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:07:27.428720 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:27.428678    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"]
Jul 18 03:07:27.431622 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:27.431595    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99930a7a-f5rcr"]
Jul 18 03:07:27.434395 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:27.434372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:27.774329 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:27.774241    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" path="/var/lib/kubelet/pods/c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9/volumes"
Jul 18 03:07:28.681913 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:28.681875    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:28.913820 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:28.913789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:29.140274 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:29.140235    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:29.447146 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:29.447062    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:29.999835 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:29.999803    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:31.911161 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:31.911126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:31.997211 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:31.997182    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:32.073311 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:32.073258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:32.199270 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:32.199155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:32.658950 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:32.658917    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:32.761688 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:32.761651    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:07:36.991651 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:36.991614    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:07:56.726364 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.722078    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"]
Jul 18 03:07:56.726364 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.722901    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" containerName="revoke-keys"
Jul 18 03:07:56.726364 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.722922    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" containerName="revoke-keys"
Jul 18 03:07:56.726364 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.723097    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94c61b7-75b1-4ecf-a80b-019eb8f4cbe9" containerName="revoke-keys"
Jul 18 03:07:56.727136 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.727080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:56.730241 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.729648    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:07:56.730241 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.730071    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:07:56.731418 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.731397    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"]
Jul 18 03:07:56.840383 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.840347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-efca33f7-rrtts\" (UID: \"20936715-fc54-4671-9c47-200804e2b537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:56.941495 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.941453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-efca33f7-rrtts\" (UID: \"20936715-fc54-4671-9c47-200804e2b537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:56.942119 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:56.942099    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-efca33f7-rrtts\" (UID: \"20936715-fc54-4671-9c47-200804e2b537\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:57.039322 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:57.039231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:57.165612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:57.165588    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"]
Jul 18 03:07:57.168077 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:07:57.168052    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20936715_fc54_4671_9c47_200804e2b537.slice/crio-ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02 WatchSource:0}: Error finding container ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02: Status 404 returned error can't find the container with id ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02
Jul 18 03:07:57.280104 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:57.280072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts" event={"ID":"20936715-fc54-4671-9c47-200804e2b537","Type":"ContainerStarted","Data":"ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02"}
Jul 18 03:07:58.285779 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:58.285743    2567 generic.go:356] "Generic (PLEG): container finished" podID="20936715-fc54-4671-9c47-200804e2b537" containerID="bfa84c662c38e4872a570b1b63fd999dbf9c3eb436fdfefcea7f6aa230d995fc" exitCode=0
Jul 18 03:07:58.286157 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:58.285838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts" event={"ID":"20936715-fc54-4671-9c47-200804e2b537","Type":"ContainerDied","Data":"bfa84c662c38e4872a570b1b63fd999dbf9c3eb436fdfefcea7f6aa230d995fc"}
Jul 18 03:07:59.418133 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:59.418110    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:07:59.463667 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:59.463640    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca\") pod \"20936715-fc54-4671-9c47-200804e2b537\" (UID: \"20936715-fc54-4671-9c47-200804e2b537\") "
Jul 18 03:07:59.464029 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:59.464007    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20936715-fc54-4671-9c47-200804e2b537" (UID: "20936715-fc54-4671-9c47-200804e2b537"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:07:59.564892 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:07:59.564813    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20936715-fc54-4671-9c47-200804e2b537-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:08:00.296774 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:00.296736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts" event={"ID":"20936715-fc54-4671-9c47-200804e2b537","Type":"ContainerDied","Data":"ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02"}
Jul 18 03:08:00.296774 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:00.296773    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"
Jul 18 03:08:00.297005 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:00.296795    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac8abcd5f9c0da3adae5052fc0b200b63c37241db8b37ea11867f18878302d02"
Jul 18 03:08:07.279431 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:07.279399    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:10.282840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:10.282800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:08:11.789598 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:11.789563    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"]
Jul 18 03:08:11.791826 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:11.791800    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-efca33f7-rrtts"]
Jul 18 03:08:11.792473 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:11.792449    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:11.947587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:11.947557    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:12.188955 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:12.188927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:12.668820 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:12.668783    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:12.760138 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:12.760111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:12.860667 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:12.860631    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:13.773207 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:13.773178    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20936715-fc54-4671-9c47-200804e2b537" path="/var/lib/kubelet/pods/20936715-fc54-4671-9c47-200804e2b537/volumes"
Jul 18 03:08:14.293005 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:14.292955    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:20.289635 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:20.289604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:20.410654 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:20.410624    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:20.490870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:20.490839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:20.590756 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:20.590671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:26.113352 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:26.113268    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:31.350748 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:31.350712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:31.451543 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:31.451506    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:52.105537 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:52.105501    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:58.583363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:58.583333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:58.686889 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:58.686846    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:08:58.784470 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:08:58.784438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:14.667089 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:14.667053    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:20.719886 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:20.719845    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:20.778225 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:20.778196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:20.866317 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:20.866286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:20.953893 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:20.953863    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:21.598405 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:21.598377    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:21.701740 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:21.701712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:31.474838 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:31.474779    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:32.257403 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:32.257369    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:38.870285 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:38.870251    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:38.973558 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:38.973522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:39.072321 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:39.072288    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:39.172382 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:39.172301    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:39.936852 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:39.936820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:40.059007 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:40.058952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:40.158547 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:40.158518    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:41.767329 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:41.767303    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:43.487152 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:43.487117    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:09:47.507481 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:47.507446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:47.572077 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:47.572046    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:48.201870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:48.201837    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:50.177608 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:50.177567    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:09:53.966398 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:53.966365    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:54.039088 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:54.039056    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:54.215860 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:54.215826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:54.527822 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:54.527796    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:54.624203 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:54.624136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:57.214875 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:57.214845    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:57.306566 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:57.306527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:57.439425 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:57.439395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:57.537489 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:57.537408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:57.985530 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:57.985485    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:09:58.086955 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:09:58.086921    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:00.288540 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:00.288503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:10:01.765362 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:01.765327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:02.460533 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:02.460496    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:02.756859 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:02.756780    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:02.853843 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:02.853815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:03.834438 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:03.834409    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:10:03.839800 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:03.839776    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:10:08.498220 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.498173    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:08.574885 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.574850    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:08.848899 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.848827    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"]
Jul 18 03:10:08.849200 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.849185    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20936715-fc54-4671-9c47-200804e2b537" containerName="revoke-keys"
Jul 18 03:10:08.849200 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.849200    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20936715-fc54-4671-9c47-200804e2b537" containerName="revoke-keys"
Jul 18 03:10:08.849343 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.849262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20936715-fc54-4671-9c47-200804e2b537" containerName="revoke-keys"
Jul 18 03:10:08.852161 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.852143    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:08.854647 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.854626    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:10:08.854753 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.854628    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:10:08.860289 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.860263    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"]
Jul 18 03:10:08.994401 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:08.994365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8\" (UID: \"d6300b8d-0567-40e9-941d-ce021756eefd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:09.095559 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.095508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8\" (UID: \"d6300b8d-0567-40e9-941d-ce021756eefd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:09.101223 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.096852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8\" (UID: \"d6300b8d-0567-40e9-941d-ce021756eefd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:09.163450 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.163422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:09.290877 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.290852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"]
Jul 18 03:10:09.293482 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:10:09.293452    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6300b8d_0567_40e9_941d_ce021756eefd.slice/crio-232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc WatchSource:0}: Error finding container 232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc: Status 404 returned error can't find the container with id 232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc
Jul 18 03:10:09.889822 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.889787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8" event={"ID":"d6300b8d-0567-40e9-941d-ce021756eefd","Type":"ContainerStarted","Data":"eabe6395609dd208a75f4f958ea84117033513d9e22ba2656e3c086402788e14"}
Jul 18 03:10:09.890210 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.889849    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8" event={"ID":"d6300b8d-0567-40e9-941d-ce021756eefd","Type":"ContainerStarted","Data":"232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc"}
Jul 18 03:10:09.905441 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:09.905391    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8" podStartSLOduration=1.905376223 podStartE2EDuration="1.905376223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:10:09.903731564 +0000 UTC m=+1806.555783264" watchObservedRunningTime="2026-07-18 03:10:09.905376223 +0000 UTC m=+1806.557427924"
Jul 18 03:10:10.896115 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:10.896085    2567 generic.go:356] "Generic (PLEG): container finished" podID="d6300b8d-0567-40e9-941d-ce021756eefd" containerID="eabe6395609dd208a75f4f958ea84117033513d9e22ba2656e3c086402788e14" exitCode=0
Jul 18 03:10:10.896506 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:10.896158    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8" event={"ID":"d6300b8d-0567-40e9-941d-ce021756eefd","Type":"ContainerDied","Data":"eabe6395609dd208a75f4f958ea84117033513d9e22ba2656e3c086402788e14"}
Jul 18 03:10:12.024041 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.024016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:12.122098 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.122062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca\") pod \"d6300b8d-0567-40e9-941d-ce021756eefd\" (UID: \"d6300b8d-0567-40e9-941d-ce021756eefd\") "
Jul 18 03:10:12.122443 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.122421    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6300b8d-0567-40e9-941d-ce021756eefd" (UID: "d6300b8d-0567-40e9-941d-ce021756eefd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:10:12.222760 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.222682    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6300b8d-0567-40e9-941d-ce021756eefd-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:10:12.907276 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.907241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8" event={"ID":"d6300b8d-0567-40e9-941d-ce021756eefd","Type":"ContainerDied","Data":"232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc"}
Jul 18 03:10:12.907276 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.907276    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"
Jul 18 03:10:12.907486 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:12.907297    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="232cbbc3ef849efc4f6f6c33a6721d2eea9cda9e4b50ed0ee1874f60b447f5dc"
Jul 18 03:10:19.229922 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:19.229879    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:19.883129 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:19.883095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:10:23.917252 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:23.917207    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"]
Jul 18 03:10:23.919049 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:23.919019    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d958dfb-zfwq8"]
Jul 18 03:10:23.919459 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:23.919439    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:24.445233 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:24.445175    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:25.773647 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:25.773612    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6300b8d-0567-40e9-941d-ce021756eefd" path="/var/lib/kubelet/pods/d6300b8d-0567-40e9-941d-ce021756eefd/volumes"
Jul 18 03:10:30.168722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.168663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:30.239105 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.239077    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:30.456077 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.455970    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:30.665923 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.665890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:30.797579 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.797494    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:30.895066 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:30.895038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:31.016161 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:31.016133    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:36.757936 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:36.757905    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:36.870487 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:36.870454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:37.106011 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:37.105954    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:37.171071 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:37.171041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:42.768924 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:42.768888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:42.869166 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:42.869136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:49.594150 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:49.594117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:49.900788 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:49.900753    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:50.198148 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:50.198066    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:52.521121 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:52.521084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:52.607254 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:52.607228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:52.674372 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:52.674343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:52.800205 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:52.800110    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:53.306056 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:53.306024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:53.408143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:53.408104    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:57.016507 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:57.016475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:10:58.585546 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:10:58.585509    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:11:09.075169 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.075134    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:11:09.075628 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.075502    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6300b8d-0567-40e9-941d-ce021756eefd" containerName="revoke-keys"
Jul 18 03:11:09.075628 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.075513    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6300b8d-0567-40e9-941d-ce021756eefd" containerName="revoke-keys"
Jul 18 03:11:09.075628 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.075575    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6300b8d-0567-40e9-941d-ce021756eefd" containerName="revoke-keys"
Jul 18 03:11:09.078570 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.078550    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.080804 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.080784    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7aa900e3\"/\"kube-root-ca.crt\""
Jul 18 03:11:09.081627 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.081603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7aa900e3\"/\"openshift-service-ca.crt\""
Jul 18 03:11:09.081754 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.081646    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7aa900e3\"/\"default-dockercfg-sn7hv\""
Jul 18 03:11:09.081754 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.081652    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7aa900e3\"/\"e2e-lifecycle-model-7aa900e3-kserve-self-signed-certs\""
Jul 18 03:11:09.089518 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.089493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:11:09.175598 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.175569    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:11:09.192634 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.192729 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.192729 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.192798 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.192798 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.192862 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.192801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwht\" (UniqueName: \"kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293570 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwht\" (UniqueName: \"kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.293722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.293690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.294131 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.294101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.294260 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.294131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.294260 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.294164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.295871 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.295848    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.296265 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.296249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.303410 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.303387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwht\" (UniqueName: \"kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht\") pod \"e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") " pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.389188 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.389163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:09.519911 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:09.519883    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:11:09.522750 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:11:09.522713    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0492fb2e_4157_4fc4_8eee_eeb63c11616b.slice/crio-9cbc3cb60eeae6a2b5de534444cedbf68573373cc36d6ac204aed6a17f4b4478 WatchSource:0}: Error finding container 9cbc3cb60eeae6a2b5de534444cedbf68573373cc36d6ac204aed6a17f4b4478: Status 404 returned error can't find the container with id 9cbc3cb60eeae6a2b5de534444cedbf68573373cc36d6ac204aed6a17f4b4478
Jul 18 03:11:10.177375 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:10.177340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" event={"ID":"0492fb2e-4157-4fc4-8eee-eeb63c11616b","Type":"ContainerStarted","Data":"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"}
Jul 18 03:11:10.177375 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:10.177381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" event={"ID":"0492fb2e-4157-4fc4-8eee-eeb63c11616b","Type":"ContainerStarted","Data":"9cbc3cb60eeae6a2b5de534444cedbf68573373cc36d6ac204aed6a17f4b4478"}
Jul 18 03:11:10.194815 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:10.194768    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" podStartSLOduration=1.194754089 podStartE2EDuration="1.194754089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:11:10.193071964 +0000 UTC m=+1866.845123677" watchObservedRunningTime="2026-07-18 03:11:10.194754089 +0000 UTC m=+1866.846805790"
Jul 18 03:11:12.577588 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:12.577557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:11:19.390064 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:19.390032    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:19.390476 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:19.390292    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:19.402657 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:19.402634    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:20.234207 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:20.234174    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:11:29.381802 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:29.381718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:11:35.498330 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.498297    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"]
Jul 18 03:11:35.501568 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.501553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:35.503764 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.503742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:11:35.503764 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.503752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:11:35.508127 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.508103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"]
Jul 18 03:11:35.605021 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.604961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2\" (UID: \"fe55cd61-dc66-481d-812f-d98cfae4c710\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:35.705947 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.705909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2\" (UID: \"fe55cd61-dc66-481d-812f-d98cfae4c710\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:35.706521 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.706502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2\" (UID: \"fe55cd61-dc66-481d-812f-d98cfae4c710\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:35.813887 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.813816    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:35.944394 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:35.944366    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"]
Jul 18 03:11:35.946547 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:11:35.946520    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe55cd61_dc66_481d_812f_d98cfae4c710.slice/crio-9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8 WatchSource:0}: Error finding container 9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8: Status 404 returned error can't find the container with id 9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8
Jul 18 03:11:36.305071 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:36.305019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2" event={"ID":"fe55cd61-dc66-481d-812f-d98cfae4c710","Type":"ContainerStarted","Data":"9a996fdbebb81dcb66f17cfdd17688fa4b1b4ab03a22832b9be420a9b375b870"}
Jul 18 03:11:36.305237 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:36.305090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2" event={"ID":"fe55cd61-dc66-481d-812f-d98cfae4c710","Type":"ContainerStarted","Data":"9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8"}
Jul 18 03:11:36.320401 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:36.320357    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2" podStartSLOduration=1.32034289 podStartE2EDuration="1.32034289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:11:36.318845027 +0000 UTC m=+1892.970896728" watchObservedRunningTime="2026-07-18 03:11:36.32034289 +0000 UTC m=+1892.972394591"
Jul 18 03:11:37.311136 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:37.311103    2567 generic.go:356] "Generic (PLEG): container finished" podID="fe55cd61-dc66-481d-812f-d98cfae4c710" containerID="9a996fdbebb81dcb66f17cfdd17688fa4b1b4ab03a22832b9be420a9b375b870" exitCode=0
Jul 18 03:11:37.311514 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:37.311173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2" event={"ID":"fe55cd61-dc66-481d-812f-d98cfae4c710","Type":"ContainerDied","Data":"9a996fdbebb81dcb66f17cfdd17688fa4b1b4ab03a22832b9be420a9b375b870"}
Jul 18 03:11:38.454443 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:38.454419    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:38.531587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:38.531554    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca\") pod \"fe55cd61-dc66-481d-812f-d98cfae4c710\" (UID: \"fe55cd61-dc66-481d-812f-d98cfae4c710\") "
Jul 18 03:11:38.531890 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:38.531868    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe55cd61-dc66-481d-812f-d98cfae4c710" (UID: "fe55cd61-dc66-481d-812f-d98cfae4c710"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:11:38.632865 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:38.632836    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe55cd61-dc66-481d-812f-d98cfae4c710-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:11:39.321623 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:39.321593    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"
Jul 18 03:11:39.321811 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:39.321620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2" event={"ID":"fe55cd61-dc66-481d-812f-d98cfae4c710","Type":"ContainerDied","Data":"9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8"}
Jul 18 03:11:39.321811 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:39.321668    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b39cdd6c568f246cb72e4df0e11cde34efd8fdb1aeef2aaf501cd1e6de9d5d8"
Jul 18 03:11:49.385314 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:49.385250    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:11:51.008657 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:51.008625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:11:55.564409 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:55.564372    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"]
Jul 18 03:11:55.566583 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:55.566561    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7aa900e3-pbnp2"]
Jul 18 03:11:55.570746 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:55.570725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:11:55.773644 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:55.773612    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe55cd61-dc66-481d-812f-d98cfae4c710" path="/var/lib/kubelet/pods/fe55cd61-dc66-481d-812f-d98cfae4c710/volumes"
Jul 18 03:11:57.810846 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:57.810814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:11:59.386918 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:11:59.386876    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:12:02.799682 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:02.799653    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:12:02.894815 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:02.894784    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:03.903015 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:03.902972    2567 scope.go:117] "RemoveContainer" containerID="568e8eb42f01f90ee30d7e1b76c69d1f85aebd13163188f5ffeed4011ac88b2b"
Jul 18 03:12:17.821097 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:17.821054    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" podUID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" containerName="main" containerID="cri-o://ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366" gracePeriod=45
Jul 18 03:12:18.056407 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.056383    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072149    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072253    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072318    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrwht\" (UniqueName: \"kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.072349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.072343    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs\") pod \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\" (UID: \"0492fb2e-4157-4fc4-8eee-eeb63c11616b\") "
Jul 18 03:12:18.073683 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.073397    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:12:18.073683 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.073627    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:12:18.073870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.073843    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home" (OuterVolumeSpecName: "home") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:12:18.076098 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.076065    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm" (OuterVolumeSpecName: "dshm") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:12:18.076098 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.076066    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:12:18.076225 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.076203    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht" (OuterVolumeSpecName: "kube-api-access-lrwht") pod "0492fb2e-4157-4fc4-8eee-eeb63c11616b" (UID: "0492fb2e-4157-4fc4-8eee-eeb63c11616b"). InnerVolumeSpecName "kube-api-access-lrwht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:12:18.173553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173522    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.173553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173547    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.173553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173556    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.173553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173563    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0492fb2e-4157-4fc4-8eee-eeb63c11616b-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.173795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173573    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrwht\" (UniqueName: \"kubernetes.io/projected/0492fb2e-4157-4fc4-8eee-eeb63c11616b-kube-api-access-lrwht\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.173795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.173583    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0492fb2e-4157-4fc4-8eee-eeb63c11616b-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:12:18.510824 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.510788    2567 generic.go:356] "Generic (PLEG): container finished" podID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" containerID="ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366" exitCode=0
Jul 18 03:12:18.511013 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.510836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" event={"ID":"0492fb2e-4157-4fc4-8eee-eeb63c11616b","Type":"ContainerDied","Data":"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"}
Jul 18 03:12:18.511013 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.510850    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"
Jul 18 03:12:18.511013 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.510867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42" event={"ID":"0492fb2e-4157-4fc4-8eee-eeb63c11616b","Type":"ContainerDied","Data":"9cbc3cb60eeae6a2b5de534444cedbf68573373cc36d6ac204aed6a17f4b4478"}
Jul 18 03:12:18.511013 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.510882    2567 scope.go:117] "RemoveContainer" containerID="ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"
Jul 18 03:12:18.519547 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.519529    2567 scope.go:117] "RemoveContainer" containerID="ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"
Jul 18 03:12:18.519789 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:12:18.519769    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366\": container with ID starting with ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366 not found: ID does not exist" containerID="ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"
Jul 18 03:12:18.519835 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.519798    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366"} err="failed to get container status \"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366\": rpc error: code = NotFound desc = could not find container \"ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366\": container with ID starting with ff61540fce4f3f5d0cfe1f53c03e94e16ee00947da092520570dadaf6b4c8366 not found: ID does not exist"
Jul 18 03:12:18.529938 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.529919    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:12:18.532557 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:18.532539    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7aa900e3/e2e-lifecycle-model-7aa900e3-kserve-576f85798c-zhq42"]
Jul 18 03:12:19.774081 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:19.774051    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" path="/var/lib/kubelet/pods/0492fb2e-4157-4fc4-8eee-eeb63c11616b/volumes"
Jul 18 03:12:39.577701 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:39.577665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:40.084214 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:40.084180    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:45.758666 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:45.758627    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:45.827951 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:45.827916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:46.021266 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:46.021163    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:46.257744 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:46.257712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:47.300569 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:47.300537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:47.397062 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:47.397027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:47.498245 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:47.498208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:48.255157 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:48.255117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:48.355097 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:48.355067    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:48.455129 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:48.455102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:49.787322 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:49.787279    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:12:49.797692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:49.797665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:55.872103 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:55.872019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:55.973078 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:55.973045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:56.560397 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:56.560349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:12:59.583308 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:12:59.583272    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:13:02.989431 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:02.989400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:03.091285 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:03.091244    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:03.189609 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:03.189562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:03.923265 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:03.923234    2567 scope.go:117] "RemoveContainer" containerID="d82cda11e7ba3b821f1ded4927115840a34fee88f9ef8240fae9719fee577a2e"
Jul 18 03:13:13.738470 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:13.738423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:14.075635 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:14.075522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:32.052075 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:32.052038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:32.154228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:32.154198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:35.032388 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:35.032352    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:41.161501 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:41.161439    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:41.302659 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:41.302623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:41.403586 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:41.403542    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:41.651506 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:41.651471    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:41.981278 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:41.981176    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:42.388105 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:42.388076    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:44.569812 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:44.569770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:44.654843 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:44.654810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:44.717565 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:44.717530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:44.914680 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:44.914647    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:45.219635 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:45.219558    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:45.320269 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:45.320237    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:49.220731 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:49.220697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:49.435172 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:49.435137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:49.738766 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:49.738734    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:49.839399 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:49.839367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:52.507362 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:52.507330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:52.582266 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:52.582237    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:52.661575 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:52.661537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:52.769760 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:52.769680    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:53.160162 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:53.160127    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:53.261037 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:53.260979    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:13:53.986070 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:53.986032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:13:56.992887 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:13:56.992854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:03.173823 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.173782    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:03.174374 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174355    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" containerName="main"
Jul 18 03:14:03.174459 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174377    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" containerName="main"
Jul 18 03:14:03.174459 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174387    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe55cd61-dc66-481d-812f-d98cfae4c710" containerName="revoke-keys"
Jul 18 03:14:03.174459 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174398    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe55cd61-dc66-481d-812f-d98cfae4c710" containerName="revoke-keys"
Jul 18 03:14:03.174609 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174500    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe55cd61-dc66-481d-812f-d98cfae4c710" containerName="revoke-keys"
Jul 18 03:14:03.174609 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.174516    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0492fb2e-4157-4fc4-8eee-eeb63c11616b" containerName="main"
Jul 18 03:14:03.177895 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.177876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.181367 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.181345    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-69f74a\"/\"openshift-service-ca.crt\""
Jul 18 03:14:03.181488 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.181362    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-69f74a\"/\"default-dockercfg-ll2g6\""
Jul 18 03:14:03.181488 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.181348    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-69f74a\"/\"test-model-69f74a-kserve-self-signed-certs\""
Jul 18 03:14:03.181488 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.181347    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-69f74a\"/\"kube-root-ca.crt\""
Jul 18 03:14:03.188834 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.188811    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:03.202927 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.202895    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:03.271142 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271101    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.271142 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.271363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.271363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqz5c\" (UniqueName: \"kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.271363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271317    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.271363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.271339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372133 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372133 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372133 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqz5c\" (UniqueName: \"kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372573 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372610 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.372643 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.372626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.374525 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.374501    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.374759 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.374743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.380425 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.380407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqz5c\" (UniqueName: \"kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c\") pod \"test-model-69f74a-kserve-69d5c7c6f9-lkc2d\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") " pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.486946 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.486840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:03.620949 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.620915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:03.624609 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:14:03.624587    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod338f05c3_6154_43db_9870_7d9c27e6a29c.slice/crio-e8f2642a2bbd2cd60109c84a2fa804bdee402e26fb3ea0904cf19ea5305aaee8 WatchSource:0}: Error finding container e8f2642a2bbd2cd60109c84a2fa804bdee402e26fb3ea0904cf19ea5305aaee8: Status 404 returned error can't find the container with id e8f2642a2bbd2cd60109c84a2fa804bdee402e26fb3ea0904cf19ea5305aaee8
Jul 18 03:14:03.945091 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.945062    2567 scope.go:117] "RemoveContainer" containerID="bfa84c662c38e4872a570b1b63fd999dbf9c3eb436fdfefcea7f6aa230d995fc"
Jul 18 03:14:03.953074 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:03.953045    2567 scope.go:117] "RemoveContainer" containerID="9e167c7d05352407e42b1b801b7003119f35d22b7f33e8dd7d8da3dc578b2700"
Jul 18 03:14:04.010525 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:04.010497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" event={"ID":"338f05c3-6154-43db-9870-7d9c27e6a29c","Type":"ContainerStarted","Data":"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"}
Jul 18 03:14:04.010639 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:04.010535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" event={"ID":"338f05c3-6154-43db-9870-7d9c27e6a29c","Type":"ContainerStarted","Data":"e8f2642a2bbd2cd60109c84a2fa804bdee402e26fb3ea0904cf19ea5305aaee8"}
Jul 18 03:14:04.028584 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:04.028537    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" podStartSLOduration=1.028521414 podStartE2EDuration="1.028521414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:14:04.026908866 +0000 UTC m=+2040.678960567" watchObservedRunningTime="2026-07-18 03:14:04.028521414 +0000 UTC m=+2040.680573115"
Jul 18 03:14:05.979692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:05.979652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:14:06.265120 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:06.265038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:06.365200 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:06.365177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:13.487584 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:13.487537    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:13.487584 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:13.487595    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:13.500628 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:13.500603    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:13.912725 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:13.912676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:14.014304 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:14.014267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:14.068577 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:14.068549    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:19.187910 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:19.187868    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:14:22.484940 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.484904    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:22.488509 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.488490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.491733 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.491707    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cde1c8\"/\"test-model-cde1c8-kserve-self-signed-certs\""
Jul 18 03:14:22.491844 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.491733    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cde1c8\"/\"default-dockercfg-ss7s6\""
Jul 18 03:14:22.491844 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.491761    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cde1c8\"/\"openshift-service-ca.crt\""
Jul 18 03:14:22.491844 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.491794    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cde1c8\"/\"kube-root-ca.crt\""
Jul 18 03:14:22.496456 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.496275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:22.508763 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.508739    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:22.535692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.535769 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.535769 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.535842 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535770    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpd9q\" (UniqueName: \"kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.535842 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.535912 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.535866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636733 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636733 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpd9q\" (UniqueName: \"kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636787    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.636909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.636818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.637188 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.637171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.637245 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.637223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.637306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.637266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.639190 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.639172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.639434 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.639418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.644281 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.644257    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpd9q\" (UniqueName: \"kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q\") pod \"test-model-cde1c8-kserve-68cd96dfc-tmfhs\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") " pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.799581 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.799493    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:22.929093 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:22.928968    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:22.931089 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:14:22.931052    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f171394_6df1_43cb_a91b_a50ceebb6869.slice/crio-6fbac5a2e1bb9173955de5c33b94295c3e159174694a8498225f6d84de93c806 WatchSource:0}: Error finding container 6fbac5a2e1bb9173955de5c33b94295c3e159174694a8498225f6d84de93c806: Status 404 returned error can't find the container with id 6fbac5a2e1bb9173955de5c33b94295c3e159174694a8498225f6d84de93c806
Jul 18 03:14:23.101312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:23.101229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" event={"ID":"3f171394-6df1-43cb-a91b-a50ceebb6869","Type":"ContainerStarted","Data":"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"}
Jul 18 03:14:23.101312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:23.101272    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" event={"ID":"3f171394-6df1-43cb-a91b-a50ceebb6869","Type":"ContainerStarted","Data":"6fbac5a2e1bb9173955de5c33b94295c3e159174694a8498225f6d84de93c806"}
Jul 18 03:14:23.120857 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:23.120811    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" podStartSLOduration=1.120795792 podStartE2EDuration="1.120795792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:14:23.118912279 +0000 UTC m=+2059.770963979" watchObservedRunningTime="2026-07-18 03:14:23.120795792 +0000 UTC m=+2059.772847492"
Jul 18 03:14:30.194258 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:30.194172    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:14:32.800197 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:32.800155    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:32.800589 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:32.800209    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:32.814181 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:32.814151    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:33.155230 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:33.155200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:40.205657 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:40.205628    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:40.227783 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:40.227758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:41.202686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.202653    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:41.221598 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.221564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:41.333229 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.333190    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"]
Jul 18 03:14:41.336543 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.336527    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:41.338810 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.338784    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:14:41.338954 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.338789    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:14:41.342624 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.342596    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"]
Jul 18 03:14:41.505204 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.505107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q\" (UID: \"8b6f7a82-ff98-4f60-afe0-51c08f2016f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:41.606166 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.606127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q\" (UID: \"8b6f7a82-ff98-4f60-afe0-51c08f2016f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:41.606725 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.606705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q\" (UID: \"8b6f7a82-ff98-4f60-afe0-51c08f2016f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:41.649259 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.649232    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:41.782047 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.781971    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"]
Jul 18 03:14:41.784247 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:14:41.784213    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6f7a82_ff98_4f60_afe0_51c08f2016f0.slice/crio-90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9 WatchSource:0}: Error finding container 90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9: Status 404 returned error can't find the container with id 90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9
Jul 18 03:14:41.886750 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.886699    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:41.990633 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:41.990607    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:42.191240 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:42.191205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q" event={"ID":"8b6f7a82-ff98-4f60-afe0-51c08f2016f0","Type":"ContainerStarted","Data":"0e75a24cbce75ee96ff4d08d6e510d6b36fb052f616f9a5cd0ae462a3c646653"}
Jul 18 03:14:42.191478 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:42.191256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q" event={"ID":"8b6f7a82-ff98-4f60-afe0-51c08f2016f0","Type":"ContainerStarted","Data":"90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9"}
Jul 18 03:14:42.205893 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:42.205843    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q" podStartSLOduration=1.205828777 podStartE2EDuration="1.205828777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:14:42.205461969 +0000 UTC m=+2078.857513687" watchObservedRunningTime="2026-07-18 03:14:42.205828777 +0000 UTC m=+2078.857880478"
Jul 18 03:14:43.197251 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:43.197216    2567 generic.go:356] "Generic (PLEG): container finished" podID="8b6f7a82-ff98-4f60-afe0-51c08f2016f0" containerID="0e75a24cbce75ee96ff4d08d6e510d6b36fb052f616f9a5cd0ae462a3c646653" exitCode=0
Jul 18 03:14:43.197684 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:43.197304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q" event={"ID":"8b6f7a82-ff98-4f60-afe0-51c08f2016f0","Type":"ContainerDied","Data":"0e75a24cbce75ee96ff4d08d6e510d6b36fb052f616f9a5cd0ae462a3c646653"}
Jul 18 03:14:43.984213 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:43.984176    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:14:44.336394 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:44.336371    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:44.431002 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:44.430951    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca\") pod \"8b6f7a82-ff98-4f60-afe0-51c08f2016f0\" (UID: \"8b6f7a82-ff98-4f60-afe0-51c08f2016f0\") "
Jul 18 03:14:44.431361 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:44.431335    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b6f7a82-ff98-4f60-afe0-51c08f2016f0" (UID: "8b6f7a82-ff98-4f60-afe0-51c08f2016f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:14:44.531604 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:44.531523    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6f7a82-ff98-4f60-afe0-51c08f2016f0-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:45.207621 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:45.207591    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"
Jul 18 03:14:45.207801 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:45.207594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q" event={"ID":"8b6f7a82-ff98-4f60-afe0-51c08f2016f0","Type":"ContainerDied","Data":"90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9"}
Jul 18 03:14:45.207801 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:45.207722    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90d3498df2faf132a6e983a9bf77acaf8bb8afae0971ab02f9d3bc8f777719c9"
Jul 18 03:14:51.735114 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:51.735084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:55.226144 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.226083    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" podUID="338f05c3-6154-43db-9870-7d9c27e6a29c" containerName="main" containerID="cri-o://faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7" gracePeriod=45
Jul 18 03:14:55.479341 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.479278    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:55.522783 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.522722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.522965 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.522799    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqz5c\" (UniqueName: \"kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.522965 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.522862    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.522965 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.522939    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.523165 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523020    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.523165 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523103    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm\") pod \"338f05c3-6154-43db-9870-7d9c27e6a29c\" (UID: \"338f05c3-6154-43db-9870-7d9c27e6a29c\") "
Jul 18 03:14:55.523268 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523156    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:55.523334 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523275    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache" (OuterVolumeSpecName: "model-cache") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:55.523446 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523424    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:55.523518 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523450    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:55.523518 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.523453    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home" (OuterVolumeSpecName: "home") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:55.525431 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.525400    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:14:55.525431 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.525406    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm" (OuterVolumeSpecName: "dshm") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:55.525431 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.525415    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c" (OuterVolumeSpecName: "kube-api-access-vqz5c") pod "338f05c3-6154-43db-9870-7d9c27e6a29c" (UID: "338f05c3-6154-43db-9870-7d9c27e6a29c"). InnerVolumeSpecName "kube-api-access-vqz5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:14:55.624512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.624468    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338f05c3-6154-43db-9870-7d9c27e6a29c-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:55.624512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.624505    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:55.624512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.624514    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338f05c3-6154-43db-9870-7d9c27e6a29c-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:55.624512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:55.624523    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqz5c\" (UniqueName: \"kubernetes.io/projected/338f05c3-6154-43db-9870-7d9c27e6a29c-kube-api-access-vqz5c\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.226928 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.226873    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" podUID="3f171394-6df1-43cb-a91b-a50ceebb6869" containerName="main" containerID="cri-o://27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4" gracePeriod=45
Jul 18 03:14:56.258298 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.258263    2567 generic.go:356] "Generic (PLEG): container finished" podID="338f05c3-6154-43db-9870-7d9c27e6a29c" containerID="faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7" exitCode=0
Jul 18 03:14:56.258429 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.258370    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"
Jul 18 03:14:56.258429 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.258383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" event={"ID":"338f05c3-6154-43db-9870-7d9c27e6a29c","Type":"ContainerDied","Data":"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"}
Jul 18 03:14:56.258429 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.258426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d" event={"ID":"338f05c3-6154-43db-9870-7d9c27e6a29c","Type":"ContainerDied","Data":"e8f2642a2bbd2cd60109c84a2fa804bdee402e26fb3ea0904cf19ea5305aaee8"}
Jul 18 03:14:56.258555 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.258450    2567 scope.go:117] "RemoveContainer" containerID="faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"
Jul 18 03:14:56.291359 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.291328    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:56.295033 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.295003    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-69f74a/test-model-69f74a-kserve-69d5c7c6f9-lkc2d"]
Jul 18 03:14:56.340173 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.340146    2567 scope.go:117] "RemoveContainer" containerID="faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"
Jul 18 03:14:56.340651 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:14:56.340630    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7\": container with ID starting with faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7 not found: ID does not exist" containerID="faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"
Jul 18 03:14:56.340749 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.340657    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7"} err="failed to get container status \"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7\": rpc error: code = NotFound desc = could not find container \"faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7\": container with ID starting with faf643b7dc3bb226e89dbd04348f22a2ab12d29fb79aadd50cbdf7217dddb8d7 not found: ID does not exist"
Jul 18 03:14:56.399109 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.399077    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"]
Jul 18 03:14:56.404109 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.404080    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69f74a-2fv4q"]
Jul 18 03:14:56.405079 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.405047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:56.484580 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.484521    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:56.532870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.532837    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.532870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.532874    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.533143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.532901    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.533143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.532955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.533143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533013    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.533143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533082    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpd9q\" (UniqueName: \"kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q\") pod \"3f171394-6df1-43cb-a91b-a50ceebb6869\" (UID: \"3f171394-6df1-43cb-a91b-a50ceebb6869\") "
Jul 18 03:14:56.533342 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:56.533342 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:56.533342 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533310    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.533342 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533327    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.533535 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.533509    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home" (OuterVolumeSpecName: "home") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:56.535325 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.535299    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm" (OuterVolumeSpecName: "dshm") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:14:56.535451 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.535370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q" (OuterVolumeSpecName: "kube-api-access-zpd9q") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "kube-api-access-zpd9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:14:56.535451 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.535418    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f171394-6df1-43cb-a91b-a50ceebb6869" (UID: "3f171394-6df1-43cb-a91b-a50ceebb6869"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:14:56.634612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.634559    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpd9q\" (UniqueName: \"kubernetes.io/projected/3f171394-6df1-43cb-a91b-a50ceebb6869-kube-api-access-zpd9q\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.634612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.634605    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f171394-6df1-43cb-a91b-a50ceebb6869-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.634612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.634616    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.634612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.634624    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f171394-6df1-43cb-a91b-a50ceebb6869-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:14:56.797702 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:56.797616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:14:57.264058 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.264028    2567 generic.go:356] "Generic (PLEG): container finished" podID="3f171394-6df1-43cb-a91b-a50ceebb6869" containerID="27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4" exitCode=0
Jul 18 03:14:57.264483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.264072    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"
Jul 18 03:14:57.264483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.264121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" event={"ID":"3f171394-6df1-43cb-a91b-a50ceebb6869","Type":"ContainerDied","Data":"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"}
Jul 18 03:14:57.264483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.264162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs" event={"ID":"3f171394-6df1-43cb-a91b-a50ceebb6869","Type":"ContainerDied","Data":"6fbac5a2e1bb9173955de5c33b94295c3e159174694a8498225f6d84de93c806"}
Jul 18 03:14:57.264483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.264179    2567 scope.go:117] "RemoveContainer" containerID="27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"
Jul 18 03:14:57.273463 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.273443    2567 scope.go:117] "RemoveContainer" containerID="27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"
Jul 18 03:14:57.273715 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:14:57.273695    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4\": container with ID starting with 27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4 not found: ID does not exist" containerID="27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"
Jul 18 03:14:57.273774 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.273722    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4"} err="failed to get container status \"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4\": rpc error: code = NotFound desc = could not find container \"27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4\": container with ID starting with 27248b39c0a8cda69d2688b7c89c35eeeb6d903908f5ea84df658830985c60d4 not found: ID does not exist"
Jul 18 03:14:57.283119 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.283092    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:57.286776 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.286755    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cde1c8/test-model-cde1c8-kserve-68cd96dfc-tmfhs"]
Jul 18 03:14:57.381926 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.381891    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:14:57.774771 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.774741    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338f05c3-6154-43db-9870-7d9c27e6a29c" path="/var/lib/kubelet/pods/338f05c3-6154-43db-9870-7d9c27e6a29c/volumes"
Jul 18 03:14:57.775146 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.775131    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f171394-6df1-43cb-a91b-a50ceebb6869" path="/var/lib/kubelet/pods/3f171394-6df1-43cb-a91b-a50ceebb6869/volumes"
Jul 18 03:14:57.775415 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:14:57.775403    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6f7a82-ff98-4f60-afe0-51c08f2016f0" path="/var/lib/kubelet/pods/8b6f7a82-ff98-4f60-afe0-51c08f2016f0/volumes"
Jul 18 03:15:00.143507 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.143469    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"]
Jul 18 03:15:00.144894 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144863    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6f7a82-ff98-4f60-afe0-51c08f2016f0" containerName="revoke-keys"
Jul 18 03:15:00.144894 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144893    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6f7a82-ff98-4f60-afe0-51c08f2016f0" containerName="revoke-keys"
Jul 18 03:15:00.145069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144910    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f171394-6df1-43cb-a91b-a50ceebb6869" containerName="main"
Jul 18 03:15:00.145069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144919    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f171394-6df1-43cb-a91b-a50ceebb6869" containerName="main"
Jul 18 03:15:00.145069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144937    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338f05c3-6154-43db-9870-7d9c27e6a29c" containerName="main"
Jul 18 03:15:00.145069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.144945    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="338f05c3-6154-43db-9870-7d9c27e6a29c" containerName="main"
Jul 18 03:15:00.145235 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.145214    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f171394-6df1-43cb-a91b-a50ceebb6869" containerName="main"
Jul 18 03:15:00.145271 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.145237    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6f7a82-ff98-4f60-afe0-51c08f2016f0" containerName="revoke-keys"
Jul 18 03:15:00.145271 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.145247    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="338f05c3-6154-43db-9870-7d9c27e6a29c" containerName="main"
Jul 18 03:15:00.150099 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.150076    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"]
Jul 18 03:15:00.150584 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.150180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"
Jul 18 03:15:00.153167 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.153144    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:15:00.154109 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.154090    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"]
Jul 18 03:15:00.154231 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.154128    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"]
Jul 18 03:15:00.154231 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.154208    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"
Jul 18 03:15:00.163434 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.163415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"
Jul 18 03:15:00.170527 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.170505    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"
Jul 18 03:15:00.310849 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.310817    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"]
Jul 18 03:15:00.314503 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:15:00.314478    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3230c1e0_b6f6_439e_a254_78e31c3023ec.slice/crio-435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5 WatchSource:0}: Error finding container 435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5: Status 404 returned error can't find the container with id 435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5
Jul 18 03:15:00.331295 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:00.331206    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"]
Jul 18 03:15:00.333311 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:15:00.333287    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43eeac1_da46_42bf_9168_e1a2b3b11c95.slice/crio-41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3 WatchSource:0}: Error finding container 41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3: Status 404 returned error can't find the container with id 41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3
Jul 18 03:15:01.288614 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.288576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52" event={"ID":"f43eeac1-da46-42bf-9168-e1a2b3b11c95","Type":"ContainerStarted","Data":"857fce0ad9d0c883fb8098d8944cc9a87be6ea1428492fdc26a2c2d5b171a3d2"}
Jul 18 03:15:01.289052 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.288637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52" event={"ID":"f43eeac1-da46-42bf-9168-e1a2b3b11c95","Type":"ContainerStarted","Data":"41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3"}
Jul 18 03:15:01.290038 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.290014    2567 generic.go:356] "Generic (PLEG): container finished" podID="3230c1e0-b6f6-439e-a254-78e31c3023ec" containerID="b3427245b43fc333460862650a76807d8267d99a9aed8840695f2200d33f0155" exitCode=0
Jul 18 03:15:01.290144 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.290049    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66" event={"ID":"3230c1e0-b6f6-439e-a254-78e31c3023ec","Type":"ContainerDied","Data":"b3427245b43fc333460862650a76807d8267d99a9aed8840695f2200d33f0155"}
Jul 18 03:15:01.290144 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.290099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66" event={"ID":"3230c1e0-b6f6-439e-a254-78e31c3023ec","Type":"ContainerStarted","Data":"435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5"}
Jul 18 03:15:01.303232 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:01.303193    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52" podStartSLOduration=1.303179075 podStartE2EDuration="1.303179075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:15:01.301900864 +0000 UTC m=+2097.953952566" watchObservedRunningTime="2026-07-18 03:15:01.303179075 +0000 UTC m=+2097.955230775"
Jul 18 03:15:02.297032 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:02.296974    2567 generic.go:356] "Generic (PLEG): container finished" podID="f43eeac1-da46-42bf-9168-e1a2b3b11c95" containerID="857fce0ad9d0c883fb8098d8944cc9a87be6ea1428492fdc26a2c2d5b171a3d2" exitCode=0
Jul 18 03:15:02.297032 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:02.297021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52" event={"ID":"f43eeac1-da46-42bf-9168-e1a2b3b11c95","Type":"ContainerDied","Data":"857fce0ad9d0c883fb8098d8944cc9a87be6ea1428492fdc26a2c2d5b171a3d2"}
Jul 18 03:15:02.425271 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:02.425245    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"
Jul 18 03:15:02.864472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:02.864440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:02.966211 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:02.966172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:03.191073 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.190965    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:03.302803 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.302754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66" event={"ID":"3230c1e0-b6f6-439e-a254-78e31c3023ec","Type":"ContainerDied","Data":"435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5"}
Jul 18 03:15:03.303229 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.302824    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="435d3ceddca5d450529c5442b6bf407aa1aef5bb4517cb7f4684fb2dc21c9ab5"
Jul 18 03:15:03.303229 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.302772    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739075-2ll66"
Jul 18 03:15:03.397012 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.396964    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:03.432816 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.432791    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"
Jul 18 03:15:03.524381 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524300    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"]
Jul 18 03:15:03.524656 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524644    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43eeac1-da46-42bf-9168-e1a2b3b11c95" containerName="cleanup"
Jul 18 03:15:03.524699 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524658    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43eeac1-da46-42bf-9168-e1a2b3b11c95" containerName="cleanup"
Jul 18 03:15:03.524699 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524673    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3230c1e0-b6f6-439e-a254-78e31c3023ec" containerName="cleanup"
Jul 18 03:15:03.524699 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524679    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3230c1e0-b6f6-439e-a254-78e31c3023ec" containerName="cleanup"
Jul 18 03:15:03.524785 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524737    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43eeac1-da46-42bf-9168-e1a2b3b11c95" containerName="cleanup"
Jul 18 03:15:03.524785 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.524748    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3230c1e0-b6f6-439e-a254-78e31c3023ec" containerName="cleanup"
Jul 18 03:15:03.527590 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.527573    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:03.531178 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.531159    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:15:03.540823 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.540800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"]
Jul 18 03:15:03.594466 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.594425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9\" (UID: \"9cf51e60-90f3-4e80-914a-74b907d8e681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:03.695156 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.695115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9\" (UID: \"9cf51e60-90f3-4e80-914a-74b907d8e681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:03.697677 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.697652    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:15:03.705800 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.705774    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9\" (UID: \"9cf51e60-90f3-4e80-914a-74b907d8e681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:03.837018 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.836970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:03.872072 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.872043    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:15:03.880120 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.880095    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:15:03.986680 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:03.986653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"]
Jul 18 03:15:03.989398 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:15:03.989375    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf51e60_90f3_4e80_914a_74b907d8e681.slice/crio-4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420 WatchSource:0}: Error finding container 4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420: Status 404 returned error can't find the container with id 4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420
Jul 18 03:15:04.195653 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.195619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:04.307970 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.307937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52" event={"ID":"f43eeac1-da46-42bf-9168-e1a2b3b11c95","Type":"ContainerDied","Data":"41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3"}
Jul 18 03:15:04.308418 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.308016    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d78021d3cbfaffdfcd3ee6a2c27ff05e8c4df8bde4b17b511073600119ccc3"
Jul 18 03:15:04.308418 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.307948    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"
Jul 18 03:15:04.309524 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.309489    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9" event={"ID":"9cf51e60-90f3-4e80-914a-74b907d8e681","Type":"ContainerStarted","Data":"09ab1d5c64c626c4152cd8e5e918f2241b25b27dc534b28b35728b129e6c10a9"}
Jul 18 03:15:04.309524 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.309527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9" event={"ID":"9cf51e60-90f3-4e80-914a-74b907d8e681","Type":"ContainerStarted","Data":"4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420"}
Jul 18 03:15:04.335007 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.334960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:04.341148 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:04.341097    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9" podStartSLOduration=1.341079005 podStartE2EDuration="1.341079005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:15:04.340950258 +0000 UTC m=+2100.993001960" watchObservedRunningTime="2026-07-18 03:15:04.341079005 +0000 UTC m=+2100.993130707"
Jul 18 03:15:05.315661 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:05.315628    2567 generic.go:356] "Generic (PLEG): container finished" podID="9cf51e60-90f3-4e80-914a-74b907d8e681" containerID="09ab1d5c64c626c4152cd8e5e918f2241b25b27dc534b28b35728b129e6c10a9" exitCode=0
Jul 18 03:15:05.316051 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:05.315680    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9" event={"ID":"9cf51e60-90f3-4e80-914a-74b907d8e681","Type":"ContainerDied","Data":"09ab1d5c64c626c4152cd8e5e918f2241b25b27dc534b28b35728b129e6c10a9"}
Jul 18 03:15:06.449249 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:06.449225    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:06.518505 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:06.518472    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca\") pod \"9cf51e60-90f3-4e80-914a-74b907d8e681\" (UID: \"9cf51e60-90f3-4e80-914a-74b907d8e681\") "
Jul 18 03:15:06.518822 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:06.518801    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cf51e60-90f3-4e80-914a-74b907d8e681" (UID: "9cf51e60-90f3-4e80-914a-74b907d8e681"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:15:06.619577 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:06.619548    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf51e60-90f3-4e80-914a-74b907d8e681-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:15:07.332835 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:07.332796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9" event={"ID":"9cf51e60-90f3-4e80-914a-74b907d8e681","Type":"ContainerDied","Data":"4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420"}
Jul 18 03:15:07.333047 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:07.332872    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e06831594d5deebe3e40801219cb2fdb215352ffaa1510c0bce740f6e14b420"
Jul 18 03:15:07.333047 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:07.332811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"
Jul 18 03:15:14.159455 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:14.159411    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"]
Jul 18 03:15:14.164306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:14.164271    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-cde1c8-29739075-t9c52"]
Jul 18 03:15:14.165307 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:14.165288    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:15.773993 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:15.773950    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f43eeac1-da46-42bf-9168-e1a2b3b11c95" path="/var/lib/kubelet/pods/f43eeac1-da46-42bf-9168-e1a2b3b11c95/volumes"
Jul 18 03:15:17.392594 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:17.392557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:15:18.589870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:18.589839    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"]
Jul 18 03:15:18.593511 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:18.593476    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cde1c8-576g9"]
Jul 18 03:15:18.594315 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:18.594291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:18.994137 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:18.994108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:19.773700 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:19.773664    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf51e60-90f3-4e80-914a-74b907d8e681" path="/var/lib/kubelet/pods/9cf51e60-90f3-4e80-914a-74b907d8e681/volumes"
Jul 18 03:15:24.918143 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:24.918108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:24.992977 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:24.992943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:25.186817 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:25.186731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:25.424516 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:25.424488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:25.798051 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:25.798017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:26.108330 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:26.108302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:26.354363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:26.354332    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.106371 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.106341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.197032 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.197000    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.274203 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.274155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.482946 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.482870    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.876591 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.876561    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:29.973038 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:29.973011    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:33.611477 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:33.611438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:34.091013 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:34.090910    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:34.430774 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:34.430740    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:35.067666 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:35.067637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:36.496274 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:36.496241    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:15:37.217293 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.217254    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:37.315679 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.315648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:37.386867 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.386835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:37.484889 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.484802    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:37.899795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.899767    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:37.998669 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:37.998642    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:41.729068 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:41.729032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:49.869851 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.869819    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"]
Jul 18 03:15:49.870315 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.870188    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf51e60-90f3-4e80-914a-74b907d8e681" containerName="revoke-keys"
Jul 18 03:15:49.870315 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.870201    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf51e60-90f3-4e80-914a-74b907d8e681" containerName="revoke-keys"
Jul 18 03:15:49.870315 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.870260    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf51e60-90f3-4e80-914a-74b907d8e681" containerName="revoke-keys"
Jul 18 03:15:49.874909 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.874891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:49.879140 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.879119    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:15:49.879228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.879186    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:15:49.882950 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.882925    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"]
Jul 18 03:15:49.980041 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:49.980012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4e7186-zz566\" (UID: \"06a0b538-d74f-4bc2-ba20-7ba5eda0abec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:50.081270 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.081236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4e7186-zz566\" (UID: \"06a0b538-d74f-4bc2-ba20-7ba5eda0abec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:50.081871 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.081853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4e7186-zz566\" (UID: \"06a0b538-d74f-4bc2-ba20-7ba5eda0abec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:50.186393 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.186312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:50.315509 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.315474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"]
Jul 18 03:15:50.318081 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:15:50.318051    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a0b538_d74f_4bc2_ba20_7ba5eda0abec.slice/crio-c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f WatchSource:0}: Error finding container c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f: Status 404 returned error can't find the container with id c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f
Jul 18 03:15:50.537629 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.537541    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:50.538778 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.538756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566" event={"ID":"06a0b538-d74f-4bc2-ba20-7ba5eda0abec","Type":"ContainerStarted","Data":"c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f"}
Jul 18 03:15:50.623812 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:50.623784    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:51.545295 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:51.545257    2567 generic.go:356] "Generic (PLEG): container finished" podID="06a0b538-d74f-4bc2-ba20-7ba5eda0abec" containerID="190f8a244d3ac441328513b48fa781ffed0aff26af230114e1ba83d67ab23700" exitCode=0
Jul 18 03:15:51.545676 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:51.545347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566" event={"ID":"06a0b538-d74f-4bc2-ba20-7ba5eda0abec","Type":"ContainerDied","Data":"190f8a244d3ac441328513b48fa781ffed0aff26af230114e1ba83d67ab23700"}
Jul 18 03:15:52.675666 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:52.675636    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:52.702514 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:52.702490    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca\") pod \"06a0b538-d74f-4bc2-ba20-7ba5eda0abec\" (UID: \"06a0b538-d74f-4bc2-ba20-7ba5eda0abec\") "
Jul 18 03:15:52.702825 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:52.702805    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06a0b538-d74f-4bc2-ba20-7ba5eda0abec" (UID: "06a0b538-d74f-4bc2-ba20-7ba5eda0abec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:15:52.804042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:52.803939    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a0b538-d74f-4bc2-ba20-7ba5eda0abec-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:15:53.292021 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:53.291975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:15:53.556692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:53.556602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566" event={"ID":"06a0b538-d74f-4bc2-ba20-7ba5eda0abec","Type":"ContainerDied","Data":"c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f"}
Jul 18 03:15:53.556692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:53.556663    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c22eef8887f881f4c5cc89dbaeee044556a9f418cbcd8c690e4fc6831d5d1f2f"
Jul 18 03:15:53.556692 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:53.556617    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"
Jul 18 03:15:58.699245 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:58.699164    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:15:58.800568 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:15:58.800515    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:00.475030 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:00.474996    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:00.575871 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:00.575839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:05.696582 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:05.696549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:08.791648 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:08.791619    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:16:09.957762 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:09.957728    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"]
Jul 18 03:16:09.959164 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:09.959133    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:09.961000 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:09.960966    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4e7186-zz566"]
Jul 18 03:16:10.485781 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:10.485747    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:11.774065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:11.774027    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a0b538-d74f-4bc2-ba20-7ba5eda0abec" path="/var/lib/kubelet/pods/06a0b538-d74f-4bc2-ba20-7ba5eda0abec/volumes"
Jul 18 03:16:16.306181 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.306149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:16.411234 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.411199    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:16.589038 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.588939    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:16.807169 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.807143    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:16.930110 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.930077    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"]
Jul 18 03:16:16.930459 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.930446    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a0b538-d74f-4bc2-ba20-7ba5eda0abec" containerName="revoke-keys"
Jul 18 03:16:16.930514 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.930462    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a0b538-d74f-4bc2-ba20-7ba5eda0abec" containerName="revoke-keys"
Jul 18 03:16:16.930553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.930516    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a0b538-d74f-4bc2-ba20-7ba5eda0abec" containerName="revoke-keys"
Jul 18 03:16:16.933461 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.933445    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:16.936298 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.936277    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:16:16.936447 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.936354    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:16:16.942928 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:16.942905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"]
Jul 18 03:16:17.002689 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.002661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl\" (UID: \"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:17.103738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.103704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl\" (UID: \"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:17.104394 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.104374    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl\" (UID: \"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:17.244919 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.244837    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:17.379731 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.379701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"]
Jul 18 03:16:17.383204 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:16:17.383177    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2a3843_7fb4_4ee0_93dd_1d0164f97ef9.slice/crio-622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7 WatchSource:0}: Error finding container 622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7: Status 404 returned error can't find the container with id 622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7
Jul 18 03:16:17.460962 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.460940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:17.561795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.561763    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:17.672602 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.672562    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl" event={"ID":"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9","Type":"ContainerStarted","Data":"fccdfeb303f30cf6a6576c9b808e4baddfe01a0951dfd12d8404fffa0856ed79"}
Jul 18 03:16:17.672749 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.672657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl" event={"ID":"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9","Type":"ContainerStarted","Data":"622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7"}
Jul 18 03:16:17.687943 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:17.687879    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl" podStartSLOduration=1.6878617930000002 podStartE2EDuration="1.687861793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:16:17.687357739 +0000 UTC m=+2174.339409454" watchObservedRunningTime="2026-07-18 03:16:17.687861793 +0000 UTC m=+2174.339913495"
Jul 18 03:16:18.679172 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:18.679132    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" containerID="fccdfeb303f30cf6a6576c9b808e4baddfe01a0951dfd12d8404fffa0856ed79" exitCode=0
Jul 18 03:16:18.679172 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:18.679173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl" event={"ID":"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9","Type":"ContainerDied","Data":"fccdfeb303f30cf6a6576c9b808e4baddfe01a0951dfd12d8404fffa0856ed79"}
Jul 18 03:16:19.814503 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:19.814477    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:19.927080 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:19.927041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca\") pod \"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9\" (UID: \"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9\") "
Jul 18 03:16:19.927452 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:19.927412    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" (UID: "4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:16:20.028220 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:20.028137    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:16:20.690456 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:20.690424    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"
Jul 18 03:16:20.690456 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:20.690444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl" event={"ID":"4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9","Type":"ContainerDied","Data":"622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7"}
Jul 18 03:16:20.690663 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:20.690496    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="622f84e68d299b19a60f9ef3f71be928e16a5d2e99a176ef99cecb40c036bcd7"
Jul 18 03:16:20.702348 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:20.702327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:23.761386 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:23.761357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:23.824662 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:23.824633    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:32.403661 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:32.403630    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:34.787919 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:34.787884    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:16:37.008122 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:37.008089    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:37.015113 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:37.015086    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"]
Jul 18 03:16:37.017715 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:37.017692    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bddfdd-pkgrl"]
Jul 18 03:16:37.419934 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:37.419893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:37.773213 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:37.773135    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" path="/var/lib/kubelet/pods/4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9/volumes"
Jul 18 03:16:43.305926 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:43.305883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:43.377553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:43.377490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:43.600146 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:43.600039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:43.890655 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:43.890624    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:44.201793 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:44.201709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:44.526284 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:44.526192    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:44.722863 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:44.722829    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:47.585294 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:47.585262    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:47.690607 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:47.690580    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:47.772547 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:47.772516    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:48.035069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:48.035035    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:48.284789 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:48.284758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:48.381841 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:48.381814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:52.111001 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:52.110947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:52.453553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:52.453461    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:52.774850 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:52.774778    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:53.915075 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:53.915036    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:55.592120 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:55.592083    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:16:55.649053 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:55.649019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:55.736743 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:55.736716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:55.828065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:55.828004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:55.984140 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:55.984109    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:56.321115 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:56.321026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:16:56.420630 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:16:56.420599    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:00.172374 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:00.172335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:03.999069 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:03.999039    2567 scope.go:117] "RemoveContainer" containerID="eabe6395609dd208a75f4f958ea84117033513d9e22ba2656e3c086402788e14"
Jul 18 03:17:07.483740 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:07.483702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:17:08.246422 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:08.246390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:09.044281 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:09.044249    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:09.146482 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:09.146430    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:17.173536 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:17.173502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:17.273833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:17.273799    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:32.694511 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.694437    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:17:32.694925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.694770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" containerName="revoke-keys"
Jul 18 03:17:32.694925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.694781    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" containerName="revoke-keys"
Jul 18 03:17:32.694925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.694843    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2a3843-7fb4-4ee0-93dd-1d0164f97ef9" containerName="revoke-keys"
Jul 18 03:17:32.698049 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.698032    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.700922 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.700901    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"openshift-service-ca.crt\""
Jul 18 03:17:32.701668 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.701649    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"auth-test-model-e88910-kserve-self-signed-certs\""
Jul 18 03:17:32.701764 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.701746    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"default-dockercfg-f2v6c\""
Jul 18 03:17:32.701839 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.701825    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"kube-root-ca.crt\""
Jul 18 03:17:32.709294 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.709272    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:17:32.731241 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.731217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:17:32.841260 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841222    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.841445 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.841445 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.841445 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.841445 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92c8j\" (UniqueName: \"kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.841619 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.841453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.941917 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.941874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.941917 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.941921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.942210 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.942003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.942210 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.942105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92c8j\" (UniqueName: \"kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.942210 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.942137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.942375 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.942213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.946042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.943107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.946042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.942350    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.946042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.943234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.946042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.945302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.946042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.945693    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:32.951092 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:32.951067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92c8j\" (UniqueName: \"kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j\") pod \"auth-test-model-e88910-kserve-56674d4d75-5cdz2\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") " pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:33.007467 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:33.007436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:33.141109 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:33.141001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:17:33.143375 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:17:33.143347    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf2ed0cb_c6a3_4b75_ad1d_4d53edecadb4.slice/crio-ba7217165e99c03200311ef69485bfd1e9ffb3ce77766b4cfcece4c46f32c31c WatchSource:0}: Error finding container ba7217165e99c03200311ef69485bfd1e9ffb3ce77766b4cfcece4c46f32c31c: Status 404 returned error can't find the container with id ba7217165e99c03200311ef69485bfd1e9ffb3ce77766b4cfcece4c46f32c31c
Jul 18 03:17:34.030686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:34.030646    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" event={"ID":"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4","Type":"ContainerStarted","Data":"a0d0a76a44c036a0b7999156336df20a7ceb2b1ee7e17c5a79f73c3684725912"}
Jul 18 03:17:34.030686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:34.030689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" event={"ID":"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4","Type":"ContainerStarted","Data":"ba7217165e99c03200311ef69485bfd1e9ffb3ce77766b4cfcece4c46f32c31c"}
Jul 18 03:17:34.051942 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:34.051873    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" podStartSLOduration=2.05185713 podStartE2EDuration="2.05185713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:17:34.050188333 +0000 UTC m=+2250.702240049" watchObservedRunningTime="2026-07-18 03:17:34.05185713 +0000 UTC m=+2250.703908834"
Jul 18 03:17:36.492112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:36.492068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:17:43.008340 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:43.008307    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:43.008788 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:43.008353    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:43.020693 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:43.020667    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:17:43.083114 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:17:43.083085    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:18:03.194633 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.194598    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:18:03.198775 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.198755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.202495 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.202473    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"default-dockercfg-x2f85\""
Jul 18 03:18:03.202495 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.202482    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"kube-root-ca.crt\""
Jul 18 03:18:03.202686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.202500    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"openshift-service-ca.crt\""
Jul 18 03:18:03.202686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.202517    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"auth-test-model-b50cfd-kserve-self-signed-certs\""
Jul 18 03:18:03.208514 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.208493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:18:03.231057 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.231023    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:18:03.289081 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.289228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp6jr\" (UniqueName: \"kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.289228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289216    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.289350 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.289350 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.289350 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.289337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390230 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390384 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390384 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390384 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp6jr\" (UniqueName: \"kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390384 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390384 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390679 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390760 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.390760 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.390747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.392722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.392702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.392923 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.392908    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.398739 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.398719    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp6jr\" (UniqueName: \"kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr\") pod \"auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") " pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.509582 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.509513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:03.643286 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:03.643261    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:18:03.645061 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:18:03.645029    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb982f6e_fd8c_4738_a891_54c4db0636f0.slice/crio-3bc8957db3817b8c123671169882005ebf5b0693ff1524cfeee56a2f6e63d305 WatchSource:0}: Error finding container 3bc8957db3817b8c123671169882005ebf5b0693ff1524cfeee56a2f6e63d305: Status 404 returned error can't find the container with id 3bc8957db3817b8c123671169882005ebf5b0693ff1524cfeee56a2f6e63d305
Jul 18 03:18:04.019147 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:04.019111    2567 scope.go:117] "RemoveContainer" containerID="9a996fdbebb81dcb66f17cfdd17688fa4b1b4ab03a22832b9be420a9b375b870"
Jul 18 03:18:04.176494 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:04.176458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" event={"ID":"fb982f6e-fd8c-4738-a891-54c4db0636f0","Type":"ContainerStarted","Data":"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"}
Jul 18 03:18:04.176494 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:04.176500    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" event={"ID":"fb982f6e-fd8c-4738-a891-54c4db0636f0","Type":"ContainerStarted","Data":"3bc8957db3817b8c123671169882005ebf5b0693ff1524cfeee56a2f6e63d305"}
Jul 18 03:18:04.194188 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:04.194146    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" podStartSLOduration=1.1941327 podStartE2EDuration="1.1941327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:18:04.192767945 +0000 UTC m=+2280.844819645" watchObservedRunningTime="2026-07-18 03:18:04.1941327 +0000 UTC m=+2280.846184401"
Jul 18 03:18:07.091713 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:07.091674    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:18:13.510502 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:13.510452    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:13.510950 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:13.510520    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:13.523335 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:13.523314    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:14.232635 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:14.232606    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:18:24.083038 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:24.083007    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:18:25.284723 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:25.284689    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:18:32.926977 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:32.926944    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:18:33.021763 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:33.021722    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:18:44.196735 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:44.196704    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:18:54.066092 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:54.066052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:18:54.136613 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:18:54.136578    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:19:01.889996 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:19:01.889903    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:19:20.886146 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:19:20.886107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:19:38.085599 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:19:38.085558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:19:57.987889 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:19:57.987856    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:20:03.905293 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:03.905261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:20:03.912117 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:03.912087    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7r88_7bc225be-fc5d-4a8e-8810-c49a78886682/ovn-acl-logging/0.log"
Jul 18 03:20:13.693141 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:13.693109    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:20:13.714043 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:13.714015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:20:14.999209 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:14.999176    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:20:15.017073 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:15.017041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:20:15.980939 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:15.980905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:20:26.876925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:26.876889    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:20:28.713363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:28.713316    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" podUID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" containerName="main" containerID="cri-o://a0d0a76a44c036a0b7999156336df20a7ceb2b1ee7e17c5a79f73c3684725912" gracePeriod=45
Jul 18 03:20:28.870480 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:28.870443    2567 generic.go:356] "Generic (PLEG): container finished" podID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" containerID="a0d0a76a44c036a0b7999156336df20a7ceb2b1ee7e17c5a79f73c3684725912" exitCode=0
Jul 18 03:20:28.870643 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:28.870514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" event={"ID":"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4","Type":"ContainerDied","Data":"a0d0a76a44c036a0b7999156336df20a7ceb2b1ee7e17c5a79f73c3684725912"}
Jul 18 03:20:28.971180 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:28.971122    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:20:29.061349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061349 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061349    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061366    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92c8j\" (UniqueName: \"kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061430    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061587 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061477    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm\") pod \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\" (UID: \"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4\") "
Jul 18 03:20:29.061795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061674    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home" (OuterVolumeSpecName: "home") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:29.061795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061748    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:29.061795 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache" (OuterVolumeSpecName: "model-cache") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:29.061956 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.061803    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.063830 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.063806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j" (OuterVolumeSpecName: "kube-api-access-92c8j") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "kube-api-access-92c8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:20:29.063934 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.063846    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:20:29.063934 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.063846    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm" (OuterVolumeSpecName: "dshm") pod "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" (UID: "df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:29.162441 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.162401    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.162441 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.162436    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92c8j\" (UniqueName: \"kubernetes.io/projected/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-kube-api-access-92c8j\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.162441 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.162445    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.162441 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.162454    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.162705 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.162462    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:29.877102 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.877079    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"
Jul 18 03:20:29.877476 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.877074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2" event={"ID":"df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4","Type":"ContainerDied","Data":"ba7217165e99c03200311ef69485bfd1e9ffb3ce77766b4cfcece4c46f32c31c"}
Jul 18 03:20:29.877476 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.877193    2567 scope.go:117] "RemoveContainer" containerID="a0d0a76a44c036a0b7999156336df20a7ceb2b1ee7e17c5a79f73c3684725912"
Jul 18 03:20:29.892545 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.892521    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:20:29.897422 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:29.897398    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/auth-test-model-e88910-kserve-56674d4d75-5cdz2"]
Jul 18 03:20:30.020082 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.020040    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" podUID="fb982f6e-fd8c-4738-a891-54c4db0636f0" containerName="main" containerID="cri-o://3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6" gracePeriod=45
Jul 18 03:20:30.273058 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.273035    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:20:30.373686 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.373644    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.373850 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.373717    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.373850 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.373773    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp6jr\" (UniqueName: \"kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.373850 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.373798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.374061 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.373933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.374061 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374036    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache\") pod \"fb982f6e-fd8c-4738-a891-54c4db0636f0\" (UID: \"fb982f6e-fd8c-4738-a891-54c4db0636f0\") "
Jul 18 03:20:30.374166 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374078    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home" (OuterVolumeSpecName: "home") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:30.374219 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374200    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:30.374318 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:30.374548 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374372    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.374548 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374391    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.374548 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.374403    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.376287 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.376266    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:20:30.376485 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.376460    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm" (OuterVolumeSpecName: "dshm") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:20:30.376485 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.376463    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr" (OuterVolumeSpecName: "kube-api-access-qp6jr") pod "fb982f6e-fd8c-4738-a891-54c4db0636f0" (UID: "fb982f6e-fd8c-4738-a891-54c4db0636f0"). InnerVolumeSpecName "kube-api-access-qp6jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:20:30.475512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.475469    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb982f6e-fd8c-4738-a891-54c4db0636f0-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.475512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.475504    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb982f6e-fd8c-4738-a891-54c4db0636f0-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.475512 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.475515    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp6jr\" (UniqueName: \"kubernetes.io/projected/fb982f6e-fd8c-4738-a891-54c4db0636f0-kube-api-access-qp6jr\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:20:30.884153 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.884116    2567 generic.go:356] "Generic (PLEG): container finished" podID="fb982f6e-fd8c-4738-a891-54c4db0636f0" containerID="3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6" exitCode=0
Jul 18 03:20:30.884564 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.884169    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"
Jul 18 03:20:30.884564 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.884202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" event={"ID":"fb982f6e-fd8c-4738-a891-54c4db0636f0","Type":"ContainerDied","Data":"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"}
Jul 18 03:20:30.884564 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.884242    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw" event={"ID":"fb982f6e-fd8c-4738-a891-54c4db0636f0","Type":"ContainerDied","Data":"3bc8957db3817b8c123671169882005ebf5b0693ff1524cfeee56a2f6e63d305"}
Jul 18 03:20:30.884564 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.884259    2567 scope.go:117] "RemoveContainer" containerID="3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"
Jul 18 03:20:30.893744 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.893725    2567 scope.go:117] "RemoveContainer" containerID="3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"
Jul 18 03:20:30.894042 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:20:30.894023    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6\": container with ID starting with 3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6 not found: ID does not exist" containerID="3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"
Jul 18 03:20:30.894116 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.894051    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6"} err="failed to get container status \"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6\": rpc error: code = NotFound desc = could not find container \"3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6\": container with ID starting with 3ff7365d3dd46713a91ddad9dab2b30346945764bc6c5ff79b0e0b3ab49013e6 not found: ID does not exist"
Jul 18 03:20:30.908263 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.905872    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:20:30.909660 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:30.909637    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/auth-test-model-b50cfd-kserve-6c9fb7f9bc-45qdw"]
Jul 18 03:20:31.773660 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.773622    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" path="/var/lib/kubelet/pods/df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4/volumes"
Jul 18 03:20:31.774115 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.774095    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb982f6e-fd8c-4738-a891-54c4db0636f0" path="/var/lib/kubelet/pods/fb982f6e-fd8c-4738-a891-54c4db0636f0/volumes"
Jul 18 03:20:31.988661 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.988625    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:20:31.989065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.988961    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb982f6e-fd8c-4738-a891-54c4db0636f0" containerName="main"
Jul 18 03:20:31.989065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.988973    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb982f6e-fd8c-4738-a891-54c4db0636f0" containerName="main"
Jul 18 03:20:31.989065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.989022    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" containerName="main"
Jul 18 03:20:31.989065 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.989028    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" containerName="main"
Jul 18 03:20:31.989201 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.989078    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2ed0cb-c6a3-4b75-ad1d-4d53edecadb4" containerName="main"
Jul 18 03:20:31.989201 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.989088    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb982f6e-fd8c-4738-a891-54c4db0636f0" containerName="main"
Jul 18 03:20:31.993235 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.993220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:31.996704 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.996678    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"sub-test-model-e88910-kserve-self-signed-certs\""
Jul 18 03:20:31.996833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.996684    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"kube-root-ca.crt\""
Jul 18 03:20:31.996833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.996685    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"default-dockercfg-f2v6c\""
Jul 18 03:20:31.996833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:31.996723    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"openshift-service-ca.crt\""
Jul 18 03:20:32.000328 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.000258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:20:32.089851 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.089758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.089851 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.089814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgl8\" (UniqueName: \"kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.090112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.089863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.090112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.089910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.090112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.090007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.090112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.090043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191473 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191631 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgl8\" (UniqueName: \"kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191631 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191631 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191631 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.191835 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.191633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.192114 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.192081    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.192114 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.192096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.192284 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.192150    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.193889 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.193871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.194044 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.194028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.199318 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.199294    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgl8\" (UniqueName: \"kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8\") pod \"sub-test-model-e88910-kserve-58c8b45bb9-mt2bs\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") " pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.203570 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.203550    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:20:32.303032 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.303005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:32.436150 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.435964    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:20:32.438238 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:20:32.438203    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3ea4f0a_6b02_4205_a153_87876b819fa1.slice/crio-b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318 WatchSource:0}: Error finding container b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318: Status 404 returned error can't find the container with id b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318
Jul 18 03:20:32.896430 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.896392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" event={"ID":"f3ea4f0a-6b02-4205-a153-87876b819fa1","Type":"ContainerStarted","Data":"ac92205afe9de939fd3c95ea83b878e5af61d18bede97cc199bde8030a09bf1b"}
Jul 18 03:20:32.896430 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.896435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" event={"ID":"f3ea4f0a-6b02-4205-a153-87876b819fa1","Type":"ContainerStarted","Data":"b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318"}
Jul 18 03:20:32.911954 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:32.911902    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" podStartSLOduration=1.911888533 podStartE2EDuration="1.911888533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:20:32.911310391 +0000 UTC m=+2429.563362091" watchObservedRunningTime="2026-07-18 03:20:32.911888533 +0000 UTC m=+2429.563940233"
Jul 18 03:20:38.782648 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:38.782607    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:20:42.303151 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:42.303117    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:42.303585 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:42.303173    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:42.315754 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:42.315729    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:42.954410 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:42.954379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:20:44.744479 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:44.744444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:20:53.593920 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.593887    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:20:53.597262 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.597243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.600851 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.600830    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"kube-root-ca.crt\""
Jul 18 03:20:53.600933 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.600858    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"sub-test-model-b50cfd-kserve-self-signed-certs\""
Jul 18 03:20:53.600933 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.600832    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"openshift-service-ca.crt\""
Jul 18 03:20:53.600933 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.600830    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"default-dockercfg-x2f85\""
Jul 18 03:20:53.609228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.609174    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:20:53.609484 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.609465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:20:53.771295 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.771295 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771297    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.771509 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.771509 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrjfx\" (UniqueName: \"kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.771509 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.771618 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.771525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.872932 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.872898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873110 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.872942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873110 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.872961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrjfx\" (UniqueName: \"kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873282 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873537 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873537 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.873737 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.873717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.875181 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.875165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.875704 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.875689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.880718 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.880700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrjfx\" (UniqueName: \"kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx\") pod \"sub-test-model-b50cfd-kserve-6d86d99579-dvr2g\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") " pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:53.906746 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:53.906728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:20:54.036578 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:54.036542    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:20:54.039506 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:20:54.039478    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf34fc1dd_75cf_4cd1_ba32_d24e12c19c5c.slice/crio-6940819b4594daf9ef7912a16d2e50fe4d5ca1b7822578a3ef887206a29e1171 WatchSource:0}: Error finding container 6940819b4594daf9ef7912a16d2e50fe4d5ca1b7822578a3ef887206a29e1171: Status 404 returned error can't find the container with id 6940819b4594daf9ef7912a16d2e50fe4d5ca1b7822578a3ef887206a29e1171
Jul 18 03:20:55.007162 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:55.007128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" event={"ID":"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c","Type":"ContainerStarted","Data":"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"}
Jul 18 03:20:55.007162 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:55.007168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" event={"ID":"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c","Type":"ContainerStarted","Data":"6940819b4594daf9ef7912a16d2e50fe4d5ca1b7822578a3ef887206a29e1171"}
Jul 18 03:20:55.026552 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:55.026503    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" podStartSLOduration=2.026486767 podStartE2EDuration="2.026486767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:20:55.026055735 +0000 UTC m=+2451.678107450" watchObservedRunningTime="2026-07-18 03:20:55.026486767 +0000 UTC m=+2451.678538468"
Jul 18 03:20:57.681846 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:20:57.681809    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:21:03.907432 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:03.907396    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:03.907817 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:03.907448    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:03.921609 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:03.921584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:04.051172 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:04.051142    2567 scope.go:117] "RemoveContainer" containerID="09ab1d5c64c626c4152cd8e5e918f2241b25b27dc534b28b35728b129e6c10a9"
Jul 18 03:21:04.061599 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:04.061577    2567 scope.go:117] "RemoveContainer" containerID="0e75a24cbce75ee96ff4d08d6e510d6b36fb052f616f9a5cd0ae462a3c646653"
Jul 18 03:21:04.063299 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:04.063280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:04.069366 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:04.069346    2567 scope.go:117] "RemoveContainer" containerID="857fce0ad9d0c883fb8098d8944cc9a87be6ea1428492fdc26a2c2d5b171a3d2"
Jul 18 03:21:12.780444 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:12.780407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:21:28.966184 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:28.966148    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:21:28.993669 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:28.993633    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:21:31.663230 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:31.663187    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:21:31.687074 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:31.687043    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:21:35.984964 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:35.984924    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:21:40.195499 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.195467    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:21:40.198961 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.198935    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.201276 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.201255    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e88910\"/\"rate-test-model-e88910-kserve-self-signed-certs\""
Jul 18 03:21:40.206818 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.206796    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:21:40.222278 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.222248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:21:40.295363 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.295516 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.295516 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.295516 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.295623 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7r8\" (UniqueName: \"kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.295623 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.295569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.396738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.396708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.396921 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.396763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.396921 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.396811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.396921 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.396841    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.397103 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.397022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.397103 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.397061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7r8\" (UniqueName: \"kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.397251 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.397215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.397385 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.397353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.397620 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.397379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.399201 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.399181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.399691 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.399675    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.405303 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.405283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7r8\" (UniqueName: \"kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8\") pod \"rate-test-model-e88910-kserve-5ccb46c4c-mxjdt\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") " pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.509935 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.509857    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:40.641717 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:40.641569    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:21:40.645041 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:21:40.645014    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d0fdcf1_1dfd_4b02_91de_50a9bd6dfb23.slice/crio-dc636c0f984d4736b4fd0ca782cb9c226e40568bbf535a07f8a55287ab1068fb WatchSource:0}: Error finding container dc636c0f984d4736b4fd0ca782cb9c226e40568bbf535a07f8a55287ab1068fb: Status 404 returned error can't find the container with id dc636c0f984d4736b4fd0ca782cb9c226e40568bbf535a07f8a55287ab1068fb
Jul 18 03:21:41.216627 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:41.216587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" event={"ID":"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23","Type":"ContainerStarted","Data":"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"}
Jul 18 03:21:41.216627 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:41.216630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" event={"ID":"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23","Type":"ContainerStarted","Data":"dc636c0f984d4736b4fd0ca782cb9c226e40568bbf535a07f8a55287ab1068fb"}
Jul 18 03:21:41.233174 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:41.233122    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" podStartSLOduration=1.233105033 podStartE2EDuration="1.233105033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:21:41.232025517 +0000 UTC m=+2497.884077218" watchObservedRunningTime="2026-07-18 03:21:41.233105033 +0000 UTC m=+2497.885156734"
Jul 18 03:21:43.987101 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:43.987057    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" podUID="f3ea4f0a-6b02-4205-a153-87876b819fa1" containerName="main" containerID="cri-o://ac92205afe9de939fd3c95ea83b878e5af61d18bede97cc199bde8030a09bf1b" gracePeriod=45
Jul 18 03:21:44.231880 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.231852    2567 generic.go:356] "Generic (PLEG): container finished" podID="f3ea4f0a-6b02-4205-a153-87876b819fa1" containerID="ac92205afe9de939fd3c95ea83b878e5af61d18bede97cc199bde8030a09bf1b" exitCode=0
Jul 18 03:21:44.232037 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.231930    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" event={"ID":"f3ea4f0a-6b02-4205-a153-87876b819fa1","Type":"ContainerDied","Data":"ac92205afe9de939fd3c95ea83b878e5af61d18bede97cc199bde8030a09bf1b"}
Jul 18 03:21:44.232037 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.231995    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs" event={"ID":"f3ea4f0a-6b02-4205-a153-87876b819fa1","Type":"ContainerDied","Data":"b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318"}
Jul 18 03:21:44.232037 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.232013    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b565c2676e687e998b2c37e1517335076a4f35cd4118342c7379e780b67bc318"
Jul 18 03:21:44.239973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.239923    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:21:44.330925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.330898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331120 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.330941    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331120 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331040    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331244 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331244 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331223    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:44.331353 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331245    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbgl8\" (UniqueName: \"kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331353 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331256    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:44.331353 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331268    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home\") pod \"f3ea4f0a-6b02-4205-a153-87876b819fa1\" (UID: \"f3ea4f0a-6b02-4205-a153-87876b819fa1\") "
Jul 18 03:21:44.331472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331441    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:44.331472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331443    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home" (OuterVolumeSpecName: "home") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:44.331472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.331451    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:44.333317 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.333289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm" (OuterVolumeSpecName: "dshm") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:44.333420 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.333294    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:21:44.333420 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.333343    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8" (OuterVolumeSpecName: "kube-api-access-zbgl8") pod "f3ea4f0a-6b02-4205-a153-87876b819fa1" (UID: "f3ea4f0a-6b02-4205-a153-87876b819fa1"). InnerVolumeSpecName "kube-api-access-zbgl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:21:44.432154 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.432124    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbgl8\" (UniqueName: \"kubernetes.io/projected/f3ea4f0a-6b02-4205-a153-87876b819fa1-kube-api-access-zbgl8\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:44.432154 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.432147    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:44.432154 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.432157    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3ea4f0a-6b02-4205-a153-87876b819fa1-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:44.432380 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:44.432167    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3ea4f0a-6b02-4205-a153-87876b819fa1-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:45.236619 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:45.236589    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"
Jul 18 03:21:45.256104 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:45.256079    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:21:45.260455 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:45.260429    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/sub-test-model-e88910-kserve-58c8b45bb9-mt2bs"]
Jul 18 03:21:45.774574 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:45.774544    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ea4f0a-6b02-4205-a153-87876b819fa1" path="/var/lib/kubelet/pods/f3ea4f0a-6b02-4205-a153-87876b819fa1/volumes"
Jul 18 03:21:46.684211 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.684126    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" podUID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" containerName="main" containerID="cri-o://17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7" gracePeriod=45
Jul 18 03:21:46.934521 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.934463    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:46.952111 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952083    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952257 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952137    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952257 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952257 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrjfx\" (UniqueName: \"kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952439 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952325    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir\") pod \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\" (UID: \"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c\") "
Jul 18 03:21:46.952623 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952582    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home" (OuterVolumeSpecName: "home") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:46.952817 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.952788    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:46.953152 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.953127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache" (OuterVolumeSpecName: "model-cache") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:46.955188 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.955164    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:21:46.955265 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.955210    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx" (OuterVolumeSpecName: "kube-api-access-mrjfx") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "kube-api-access-mrjfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:21:46.955664 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:46.955642    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm" (OuterVolumeSpecName: "dshm") pod "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" (UID: "f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:21:47.053877 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053837    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.053877 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053872    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.053877 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053881    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.054112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053888    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.054112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053896    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrjfx\" (UniqueName: \"kubernetes.io/projected/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-kube-api-access-mrjfx\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.054112 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.053910    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:21:47.247050 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.246941    2567 generic.go:356] "Generic (PLEG): container finished" podID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" containerID="17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7" exitCode=0
Jul 18 03:21:47.247050 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.247011    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"
Jul 18 03:21:47.247050 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.247036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" event={"ID":"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c","Type":"ContainerDied","Data":"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"}
Jul 18 03:21:47.247287 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.247085    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g" event={"ID":"f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c","Type":"ContainerDied","Data":"6940819b4594daf9ef7912a16d2e50fe4d5ca1b7822578a3ef887206a29e1171"}
Jul 18 03:21:47.247287 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.247108    2567 scope.go:117] "RemoveContainer" containerID="17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"
Jul 18 03:21:47.256754 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.256732    2567 scope.go:117] "RemoveContainer" containerID="17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"
Jul 18 03:21:47.257017 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:21:47.256994    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7\": container with ID starting with 17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7 not found: ID does not exist" containerID="17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"
Jul 18 03:21:47.257072 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.257024    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7"} err="failed to get container status \"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7\": rpc error: code = NotFound desc = could not find container \"17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7\": container with ID starting with 17f789d9358abc9bd4e32d2a5e299c4bb55e7df65ab0650b948f384f9ba254a7 not found: ID does not exist"
Jul 18 03:21:47.270485 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.268376    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:21:47.275197 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.275167    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/sub-test-model-b50cfd-kserve-6d86d99579-dvr2g"]
Jul 18 03:21:47.773655 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:47.773623    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" path="/var/lib/kubelet/pods/f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c/volumes"
Jul 18 03:21:50.185159 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:50.185111    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:21:50.511006 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:50.510892    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:50.511171 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:50.511057    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:50.523275 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:50.523249    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:21:51.278454 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:21:51.278426    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:22:04.104969 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:04.104883    2567 scope.go:117] "RemoveContainer" containerID="190f8a244d3ac441328513b48fa781ffed0aff26af230114e1ba83d67ab23700"
Jul 18 03:22:05.879003 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.878954    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:22:05.879377 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879339    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ea4f0a-6b02-4205-a153-87876b819fa1" containerName="main"
Jul 18 03:22:05.879377 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879353    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ea4f0a-6b02-4205-a153-87876b819fa1" containerName="main"
Jul 18 03:22:05.879377 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879375    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" containerName="main"
Jul 18 03:22:05.879504 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879380    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" containerName="main"
Jul 18 03:22:05.879504 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879425    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34fc1dd-75cf-4cd1-ba32-d24e12c19c5c" containerName="main"
Jul 18 03:22:05.879504 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.879434    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ea4f0a-6b02-4205-a153-87876b819fa1" containerName="main"
Jul 18 03:22:05.884100 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.884079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:05.887306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.887280    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"kube-root-ca.crt\""
Jul 18 03:22:05.887306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.887293    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"openshift-service-ca.crt\""
Jul 18 03:22:05.887484 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.887290    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"rate-test-model-b50cfd-kserve-self-signed-certs\""
Jul 18 03:22:05.887484 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.887342    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b50cfd\"/\"default-dockercfg-x2f85\""
Jul 18 03:22:05.892321 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.892297    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:22:05.905820 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:05.905798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:06.016516 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.016738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.016738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfqd\" (UniqueName: \"kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.016738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.016738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016650    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.016738 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.016672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117552 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117777 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117777 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfqd\" (UniqueName: \"kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117777 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117777 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.117777 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.117742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.118079 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.118014    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.118079 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.118049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.118145 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.118131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.120068 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.120049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.120323 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.120304    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.125110 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.125091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfqd\" (UniqueName: \"kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd\") pod \"rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") " pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.194250 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.194187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:06.324701 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.324527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:22:06.327419 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:22:06.327388    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bdf297d_5192_4b2b_a8c2_e58b4b18117b.slice/crio-eddc271741ab0b51b8e5ef84c72281348895cf5222bfd9c1e2ef9b672a5fb3f1 WatchSource:0}: Error finding container eddc271741ab0b51b8e5ef84c72281348895cf5222bfd9c1e2ef9b672a5fb3f1: Status 404 returned error can't find the container with id eddc271741ab0b51b8e5ef84c72281348895cf5222bfd9c1e2ef9b672a5fb3f1
Jul 18 03:22:06.344342 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:06.344311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" event={"ID":"9bdf297d-5192-4b2b-a8c2-e58b4b18117b","Type":"ContainerStarted","Data":"eddc271741ab0b51b8e5ef84c72281348895cf5222bfd9c1e2ef9b672a5fb3f1"}
Jul 18 03:22:07.350703 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:07.350668    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" event={"ID":"9bdf297d-5192-4b2b-a8c2-e58b4b18117b","Type":"ContainerStarted","Data":"26e3006347b35a3e49bd6d1d8ad34fa82f024bc9f00061b0fd00e78c4d6da0b5"}
Jul 18 03:22:07.367167 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:07.367122    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" podStartSLOduration=2.367107872 podStartE2EDuration="2.367107872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:22:07.364731682 +0000 UTC m=+2524.016783382" watchObservedRunningTime="2026-07-18 03:22:07.367107872 +0000 UTC m=+2524.019159601"
Jul 18 03:22:09.769764 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:09.769726    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:09.868798 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:09.868760    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:10.191136 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:10.191100    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:22:16.194603 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:16.194555    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:16.195160 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:16.194833    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:16.207243 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:16.207214    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:16.402139 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:16.402113    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:22:17.840411 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:17.840368    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:17.942270 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:17.942241    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:32.380593 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:32.380560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:22:47.685408 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:47.685372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:22:55.562436 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:55.562401    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:22:55.579291 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:55.579256    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:57.516871 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:57.516838    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:22:57.536113 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:57.536080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:22:58.489705 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.489669    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312659134128"]
Jul 18 03:22:58.493138 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.493120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:22:58.495679 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.495648    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tq8jb\""
Jul 18 03:22:58.496221 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.496172    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312659134128"]
Jul 18 03:22:58.590863 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.590833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4mr\" (UniqueName: \"kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr\") pod \"test-curl-7447-140312659134128\" (UID: \"a24a6abe-e24f-4f1e-bd9e-53556e04ae63\") " pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:22:58.691865 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.691836    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4mr\" (UniqueName: \"kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr\") pod \"test-curl-7447-140312659134128\" (UID: \"a24a6abe-e24f-4f1e-bd9e-53556e04ae63\") " pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:22:58.699818 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.699790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4mr\" (UniqueName: \"kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr\") pod \"test-curl-7447-140312659134128\" (UID: \"a24a6abe-e24f-4f1e-bd9e-53556e04ae63\") " pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:22:58.804645 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:58.804571    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:22:59.143369 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:59.143343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312659134128"]
Jul 18 03:22:59.145177 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:22:59.145148    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda24a6abe_e24f_4f1e_bd9e_53556e04ae63.slice/crio-95a59d11e338177d626cc9068da1eaf9fd2c18fca8424ef24465f8887a154cb7 WatchSource:0}: Error finding container 95a59d11e338177d626cc9068da1eaf9fd2c18fca8424ef24465f8887a154cb7: Status 404 returned error can't find the container with id 95a59d11e338177d626cc9068da1eaf9fd2c18fca8424ef24465f8887a154cb7
Jul 18 03:22:59.146529 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:59.146511    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 03:22:59.597033 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:22:59.596939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312659134128" event={"ID":"a24a6abe-e24f-4f1e-bd9e-53556e04ae63","Type":"ContainerStarted","Data":"95a59d11e338177d626cc9068da1eaf9fd2c18fca8424ef24465f8887a154cb7"}
Jul 18 03:23:00.603343 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:00.603311    2567 generic.go:356] "Generic (PLEG): container finished" podID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" containerID="711fced82ea0e2210faf7e4a77897b544817cae773c2fa31117d58fcef891257" exitCode=0
Jul 18 03:23:00.603730 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:00.603409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312659134128" event={"ID":"a24a6abe-e24f-4f1e-bd9e-53556e04ae63","Type":"ContainerDied","Data":"711fced82ea0e2210faf7e4a77897b544817cae773c2fa31117d58fcef891257"}
Jul 18 03:23:01.737081 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.737060    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:23:01.754978 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.754956    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312659134128_a24a6abe-e24f-4f1e-bd9e-53556e04ae63/test-curl-7447-140312659134128/0.log"
Jul 18 03:23:01.778400 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.778377    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312659134128"]
Jul 18 03:23:01.780260 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.780240    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312659134128"]
Jul 18 03:23:01.820807 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.820784    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l4mr\" (UniqueName: \"kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr\") pod \"a24a6abe-e24f-4f1e-bd9e-53556e04ae63\" (UID: \"a24a6abe-e24f-4f1e-bd9e-53556e04ae63\") "
Jul 18 03:23:01.823071 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.823049    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr" (OuterVolumeSpecName: "kube-api-access-4l4mr") pod "a24a6abe-e24f-4f1e-bd9e-53556e04ae63" (UID: "a24a6abe-e24f-4f1e-bd9e-53556e04ae63"). InnerVolumeSpecName "kube-api-access-4l4mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:01.900386 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.900317    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312659134256"]
Jul 18 03:23:01.900663 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.900652    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" containerName="test-curl-7447-140312659134128"
Jul 18 03:23:01.900705 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.900665    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" containerName="test-curl-7447-140312659134128"
Jul 18 03:23:01.900749 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.900740    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" containerName="test-curl-7447-140312659134128"
Jul 18 03:23:01.903525 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.903510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:01.909352 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.909330    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312659134256"]
Jul 18 03:23:01.921554 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:01.921529    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l4mr\" (UniqueName: \"kubernetes.io/projected/a24a6abe-e24f-4f1e-bd9e-53556e04ae63-kube-api-access-4l4mr\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:02.022976 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.022940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7t2\" (UniqueName: \"kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2\") pod \"test-curl-7447-140312659134256\" (UID: \"bc33faac-5f51-464b-852e-ae9218eb0aca\") " pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:02.124292 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.124255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7t2\" (UniqueName: \"kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2\") pod \"test-curl-7447-140312659134256\" (UID: \"bc33faac-5f51-464b-852e-ae9218eb0aca\") " pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:02.132322 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.132301    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7t2\" (UniqueName: \"kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2\") pod \"test-curl-7447-140312659134256\" (UID: \"bc33faac-5f51-464b-852e-ae9218eb0aca\") " pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:02.214813 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.214730    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:02.342206 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.342182    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312659134256"]
Jul 18 03:23:02.344774 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:02.344743    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc33faac_5f51_464b_852e_ae9218eb0aca.slice/crio-5fc718a6b1a16ec037d35e2f4f5cbe67b9ba22f804dc94b210521180bc411262 WatchSource:0}: Error finding container 5fc718a6b1a16ec037d35e2f4f5cbe67b9ba22f804dc94b210521180bc411262: Status 404 returned error can't find the container with id 5fc718a6b1a16ec037d35e2f4f5cbe67b9ba22f804dc94b210521180bc411262
Jul 18 03:23:02.614047 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.614021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312659134256" event={"ID":"bc33faac-5f51-464b-852e-ae9218eb0aca","Type":"ContainerStarted","Data":"5fc718a6b1a16ec037d35e2f4f5cbe67b9ba22f804dc94b210521180bc411262"}
Jul 18 03:23:02.615233 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.615217    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:23:02.615299 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:02.615258    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a59d11e338177d626cc9068da1eaf9fd2c18fca8424ef24465f8887a154cb7"
Jul 18 03:23:02.625548 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:02.625524    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312659134128\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:23:03.620763 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:03.620729    2567 generic.go:356] "Generic (PLEG): container finished" podID="bc33faac-5f51-464b-852e-ae9218eb0aca" containerID="5ac1283639be859d514e6ceb1b5905781b53a9fa4f07f67e65a61636cc5fa2d8" exitCode=0
Jul 18 03:23:03.621195 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:03.620816    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312659134256" event={"ID":"bc33faac-5f51-464b-852e-ae9218eb0aca","Type":"ContainerDied","Data":"5ac1283639be859d514e6ceb1b5905781b53a9fa4f07f67e65a61636cc5fa2d8"}
Jul 18 03:23:03.622886 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:03.622867    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312659134128\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:23:03.772545 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:03.772497    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312659134128\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" pod="opendatahub/test-curl-7447-140312659134128"
Jul 18 03:23:03.773922 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:03.773896    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24a6abe-e24f-4f1e-bd9e-53556e04ae63" path="/var/lib/kubelet/pods/a24a6abe-e24f-4f1e-bd9e-53556e04ae63/volumes"
Jul 18 03:23:04.129468 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.129430    2567 scope.go:117] "RemoveContainer" containerID="fccdfeb303f30cf6a6576c9b808e4baddfe01a0951dfd12d8404fffa0856ed79"
Jul 18 03:23:04.761755 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.761729    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:04.780284 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.780260    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312659134256_bc33faac-5f51-464b-852e-ae9218eb0aca/test-curl-7447-140312659134256/0.log"
Jul 18 03:23:04.803008 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.802958    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312659134256"]
Jul 18 03:23:04.806964 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.806928    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312659134256"]
Jul 18 03:23:04.847357 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.847329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj7t2\" (UniqueName: \"kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2\") pod \"bc33faac-5f51-464b-852e-ae9218eb0aca\" (UID: \"bc33faac-5f51-464b-852e-ae9218eb0aca\") "
Jul 18 03:23:04.849556 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.849533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2" (OuterVolumeSpecName: "kube-api-access-vj7t2") pod "bc33faac-5f51-464b-852e-ae9218eb0aca" (UID: "bc33faac-5f51-464b-852e-ae9218eb0aca"). InnerVolumeSpecName "kube-api-access-vj7t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:04.948153 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.948050    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj7t2\" (UniqueName: \"kubernetes.io/projected/bc33faac-5f51-464b-852e-ae9218eb0aca-kube-api-access-vj7t2\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:04.972541 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.972507    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:04.972877 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.972864    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc33faac-5f51-464b-852e-ae9218eb0aca" containerName="test-curl-7447-140312659134256"
Jul 18 03:23:04.972930 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.972879    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc33faac-5f51-464b-852e-ae9218eb0aca" containerName="test-curl-7447-140312659134256"
Jul 18 03:23:04.972971 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.972951    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc33faac-5f51-464b-852e-ae9218eb0aca" containerName="test-curl-7447-140312659134256"
Jul 18 03:23:04.975788 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.975772    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:04.982186 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:04.982156    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:05.049514 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.049473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9stj\" (UniqueName: \"kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj\") pod \"test-curl-7447-140312655840432\" (UID: \"0fcc207c-f7f0-48e3-b68c-73723a4ee94a\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:05.150408 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.150361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9stj\" (UniqueName: \"kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj\") pod \"test-curl-7447-140312655840432\" (UID: \"0fcc207c-f7f0-48e3-b68c-73723a4ee94a\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:05.158127 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.158097    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9stj\" (UniqueName: \"kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj\") pod \"test-curl-7447-140312655840432\" (UID: \"0fcc207c-f7f0-48e3-b68c-73723a4ee94a\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:05.285762 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.285677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:05.417075 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.417047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:05.419548 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:05.419520    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fcc207c_f7f0_48e3_b68c_73723a4ee94a.slice/crio-1d7414ada4a57839729018b4d0e4b1c87e6602258fe63ba93c802779a702c828 WatchSource:0}: Error finding container 1d7414ada4a57839729018b4d0e4b1c87e6602258fe63ba93c802779a702c828: Status 404 returned error can't find the container with id 1d7414ada4a57839729018b4d0e4b1c87e6602258fe63ba93c802779a702c828
Jul 18 03:23:05.632336 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.632308    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:05.632510 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.632322    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fc718a6b1a16ec037d35e2f4f5cbe67b9ba22f804dc94b210521180bc411262"
Jul 18 03:23:05.633573 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.633547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655840432" event={"ID":"0fcc207c-f7f0-48e3-b68c-73723a4ee94a","Type":"ContainerStarted","Data":"1d7414ada4a57839729018b4d0e4b1c87e6602258fe63ba93c802779a702c828"}
Jul 18 03:23:05.643205 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:05.643179    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312659134256\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="bc33faac-5f51-464b-852e-ae9218eb0aca" pod="opendatahub/test-curl-7447-140312659134256"
Jul 18 03:23:05.776092 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:05.776059    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc33faac-5f51-464b-852e-ae9218eb0aca" path="/var/lib/kubelet/pods/bc33faac-5f51-464b-852e-ae9218eb0aca/volumes"
Jul 18 03:23:06.641487 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:06.641447    2567 generic.go:356] "Generic (PLEG): container finished" podID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" containerID="38a2a44c427bd429dddfdc80ab1a49a164b09bd717e287d575c52c98ae9ba117" exitCode=0
Jul 18 03:23:06.641681 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:06.641526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655840432" event={"ID":"0fcc207c-f7f0-48e3-b68c-73723a4ee94a","Type":"ContainerDied","Data":"38a2a44c427bd429dddfdc80ab1a49a164b09bd717e287d575c52c98ae9ba117"}
Jul 18 03:23:07.776191 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.776169    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:07.795508 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.795486    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312655840432_0fcc207c-f7f0-48e3-b68c-73723a4ee94a/test-curl-7447-140312655840432/0.log"
Jul 18 03:23:07.818058 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.818034    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:07.821525 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.821493    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:07.871966 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.871939    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9stj\" (UniqueName: \"kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj\") pod \"0fcc207c-f7f0-48e3-b68c-73723a4ee94a\" (UID: \"0fcc207c-f7f0-48e3-b68c-73723a4ee94a\") "
Jul 18 03:23:07.874144 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.874120    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj" (OuterVolumeSpecName: "kube-api-access-g9stj") pod "0fcc207c-f7f0-48e3-b68c-73723a4ee94a" (UID: "0fcc207c-f7f0-48e3-b68c-73723a4ee94a"). InnerVolumeSpecName "kube-api-access-g9stj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:07.941498 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.941432    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:07.941765 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.941753    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:07.941818 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.941767    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:07.941858 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.941837    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:07.944671 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.944657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:07.948570 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.948548    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:07.973386 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:07.973364    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9stj\" (UniqueName: \"kubernetes.io/projected/0fcc207c-f7f0-48e3-b68c-73723a4ee94a-kube-api-access-g9stj\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:08.074042 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.074009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ps5\" (UniqueName: \"kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5\") pod \"test-curl-7447-140312655840432\" (UID: \"068d960c-fae1-4c4b-afc7-19cfff8d35f2\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:08.174722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.174688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ps5\" (UniqueName: \"kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5\") pod \"test-curl-7447-140312655840432\" (UID: \"068d960c-fae1-4c4b-afc7-19cfff8d35f2\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:08.182885 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.182856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ps5\" (UniqueName: \"kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5\") pod \"test-curl-7447-140312655840432\" (UID: \"068d960c-fae1-4c4b-afc7-19cfff8d35f2\") " pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:08.255005 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.254912    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:08.381796 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.381772    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:08.384279 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:08.384257    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod068d960c_fae1_4c4b_afc7_19cfff8d35f2.slice/crio-8648f9ce15774686dbe2d4055c26b71b96c3e718192da312a2367cae2c04da69 WatchSource:0}: Error finding container 8648f9ce15774686dbe2d4055c26b71b96c3e718192da312a2367cae2c04da69: Status 404 returned error can't find the container with id 8648f9ce15774686dbe2d4055c26b71b96c3e718192da312a2367cae2c04da69
Jul 18 03:23:08.652037 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.652001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655840432" event={"ID":"068d960c-fae1-4c4b-afc7-19cfff8d35f2","Type":"ContainerStarted","Data":"8648f9ce15774686dbe2d4055c26b71b96c3e718192da312a2367cae2c04da69"}
Jul 18 03:23:08.653306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.653285    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d7414ada4a57839729018b4d0e4b1c87e6602258fe63ba93c802779a702c828"
Jul 18 03:23:08.653306 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.653291    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:08.666193 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:08.666165    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7447-140312655840432" oldPodUID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2"
Jul 18 03:23:09.283367 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:09.283334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:23:09.658998 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:09.658949    2567 generic.go:356] "Generic (PLEG): container finished" podID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" containerID="0db5960cd7ca3f8e57ad71f848cc02c03694f3c295de335a1508d53d072fc2cf" exitCode=0
Jul 18 03:23:09.659164 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:09.659016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655840432" event={"ID":"068d960c-fae1-4c4b-afc7-19cfff8d35f2","Type":"ContainerDied","Data":"0db5960cd7ca3f8e57ad71f848cc02c03694f3c295de335a1508d53d072fc2cf"}
Jul 18 03:23:09.773523 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:09.773491    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcc207c-f7f0-48e3-b68c-73723a4ee94a" path="/var/lib/kubelet/pods/0fcc207c-f7f0-48e3-b68c-73723a4ee94a/volumes"
Jul 18 03:23:10.583399 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.583359    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" podUID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" containerName="main" containerID="cri-o://60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789" gracePeriod=45
Jul 18 03:23:10.810295 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.810263    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:10.829896 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.829866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312655840432_068d960c-fae1-4c4b-afc7-19cfff8d35f2/test-curl-7447-140312655840432/0.log"
Jul 18 03:23:10.848001 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.847931    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:23:10.855287 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.855266    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:10.856687 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.856667    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312655840432"]
Jul 18 03:23:10.907868 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.907840    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7ps5\" (UniqueName: \"kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5\") pod \"068d960c-fae1-4c4b-afc7-19cfff8d35f2\" (UID: \"068d960c-fae1-4c4b-afc7-19cfff8d35f2\") "
Jul 18 03:23:10.910108 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.910084    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5" (OuterVolumeSpecName: "kube-api-access-x7ps5") pod "068d960c-fae1-4c4b-afc7-19cfff8d35f2" (UID: "068d960c-fae1-4c4b-afc7-19cfff8d35f2"). InnerVolumeSpecName "kube-api-access-x7ps5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:10.979421 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979381    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:10.979797 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979778    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" containerName="main"
Jul 18 03:23:10.979886 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979799    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" containerName="main"
Jul 18 03:23:10.979886 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979822    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:10.979886 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:10.980068 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979924    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" containerName="test-curl-7447-140312655840432"
Jul 18 03:23:10.980068 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.979942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" containerName="main"
Jul 18 03:23:10.982887 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.982866    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:10.988427 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:10.988406    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:11.009060 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009036    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj7r8\" (UniqueName: \"kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009173    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009317 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009228    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009317 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009262    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home\") pod \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\" (UID: \"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23\") "
Jul 18 03:23:11.009419 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009366    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:11.009472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009412    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:11.009614 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009567    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home" (OuterVolumeSpecName: "home") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:11.009614 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009571    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.009614 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009603    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.009614 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.009617    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7ps5\" (UniqueName: \"kubernetes.io/projected/068d960c-fae1-4c4b-afc7-19cfff8d35f2-kube-api-access-x7ps5\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.011224 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.011203    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8" (OuterVolumeSpecName: "kube-api-access-rj7r8") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "kube-api-access-rj7r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:11.011303 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.011253    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm" (OuterVolumeSpecName: "dshm") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:11.011744 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.011719    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" (UID: "8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:23:11.110307 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.110264    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p476\" (UniqueName: \"kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476\") pod \"test-curl-7447-140312655841440\" (UID: \"af1d550f-6ef4-492b-83f7-508302555305\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:11.110461 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.110392    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.110461 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.110404    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.110461 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.110412    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.110461 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.110421    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj7r8\" (UniqueName: \"kubernetes.io/projected/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23-kube-api-access-rj7r8\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:11.211824 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.211782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p476\" (UniqueName: \"kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476\") pod \"test-curl-7447-140312655841440\" (UID: \"af1d550f-6ef4-492b-83f7-508302555305\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:11.220350 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.220327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p476\" (UniqueName: \"kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476\") pod \"test-curl-7447-140312655841440\" (UID: \"af1d550f-6ef4-492b-83f7-508302555305\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:11.294049 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.294010    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:11.421269 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.421204    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:11.425263 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:11.425230    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf1d550f_6ef4_492b_83f7_508302555305.slice/crio-841399308d2e89a99f1505343e9c5d7d1987f849025b66b276d8c3bd853490f4 WatchSource:0}: Error finding container 841399308d2e89a99f1505343e9c5d7d1987f849025b66b276d8c3bd853490f4: Status 404 returned error can't find the container with id 841399308d2e89a99f1505343e9c5d7d1987f849025b66b276d8c3bd853490f4
Jul 18 03:23:11.669369 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.669277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655841440" event={"ID":"af1d550f-6ef4-492b-83f7-508302555305","Type":"ContainerStarted","Data":"841399308d2e89a99f1505343e9c5d7d1987f849025b66b276d8c3bd853490f4"}
Jul 18 03:23:11.670526 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.670502    2567 generic.go:356] "Generic (PLEG): container finished" podID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" containerID="60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789" exitCode=0
Jul 18 03:23:11.670619 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.670551    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"
Jul 18 03:23:11.670619 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.670596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" event={"ID":"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23","Type":"ContainerDied","Data":"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"}
Jul 18 03:23:11.670731 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.670639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt" event={"ID":"8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23","Type":"ContainerDied","Data":"dc636c0f984d4736b4fd0ca782cb9c226e40568bbf535a07f8a55287ab1068fb"}
Jul 18 03:23:11.670731 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.670669    2567 scope.go:117] "RemoveContainer" containerID="60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"
Jul 18 03:23:11.672102 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.672085    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8648f9ce15774686dbe2d4055c26b71b96c3e718192da312a2367cae2c04da69"
Jul 18 03:23:11.672102 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.672098    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:11.680876 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.680860    2567 scope.go:117] "RemoveContainer" containerID="60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"
Jul 18 03:23:11.681157 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:11.681141    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789\": container with ID starting with 60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789 not found: ID does not exist" containerID="60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"
Jul 18 03:23:11.681209 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.681168    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789"} err="failed to get container status \"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789\": rpc error: code = NotFound desc = could not find container \"60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789\": container with ID starting with 60643db666ffa9f80302fff70d2f9f86aec745eb957f0da22826880a2871c789 not found: ID does not exist"
Jul 18 03:23:11.693838 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.693817    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:23:11.697409 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:11.697378    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312655840432\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:11.697553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.697534    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e88910/rate-test-model-e88910-kserve-5ccb46c4c-mxjdt"]
Jul 18 03:23:11.698901 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:11.698880    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312655840432\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" pod="opendatahub/test-curl-7447-140312655840432"
Jul 18 03:23:11.774117 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.774086    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068d960c-fae1-4c4b-afc7-19cfff8d35f2" path="/var/lib/kubelet/pods/068d960c-fae1-4c4b-afc7-19cfff8d35f2/volumes"
Jul 18 03:23:11.774483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:11.774468    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23" path="/var/lib/kubelet/pods/8d0fdcf1-1dfd-4b02-91de-50a9bd6dfb23/volumes"
Jul 18 03:23:12.537937 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.537897    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" podUID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" containerName="main" containerID="cri-o://26e3006347b35a3e49bd6d1d8ad34fa82f024bc9f00061b0fd00e78c4d6da0b5" gracePeriod=45
Jul 18 03:23:12.680599 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.680567    2567 generic.go:356] "Generic (PLEG): container finished" podID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" containerID="26e3006347b35a3e49bd6d1d8ad34fa82f024bc9f00061b0fd00e78c4d6da0b5" exitCode=0
Jul 18 03:23:12.681030 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.680638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" event={"ID":"9bdf297d-5192-4b2b-a8c2-e58b4b18117b","Type":"ContainerDied","Data":"26e3006347b35a3e49bd6d1d8ad34fa82f024bc9f00061b0fd00e78c4d6da0b5"}
Jul 18 03:23:12.682214 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.682189    2567 generic.go:356] "Generic (PLEG): container finished" podID="af1d550f-6ef4-492b-83f7-508302555305" containerID="fe7211e78681dd46b7286d6edf272743b69f3d14ab1250e0b429718a185fbce0" exitCode=0
Jul 18 03:23:12.682303 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.682283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655841440" event={"ID":"af1d550f-6ef4-492b-83f7-508302555305","Type":"ContainerDied","Data":"fe7211e78681dd46b7286d6edf272743b69f3d14ab1250e0b429718a185fbce0"}
Jul 18 03:23:12.793769 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.793703    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:23:12.827664 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827634    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.827840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827691    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.827840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827714    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.827840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827740    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.827840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smfqd\" (UniqueName: \"kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.827840 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.827807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache\") pod \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\" (UID: \"9bdf297d-5192-4b2b-a8c2-e58b4b18117b\") "
Jul 18 03:23:12.828130 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.828023    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home" (OuterVolumeSpecName: "home") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:12.828130 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.828069    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:12.828251 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.828186    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache" (OuterVolumeSpecName: "model-cache") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:12.830129 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.830099    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm" (OuterVolumeSpecName: "dshm") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:23:12.830253 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.830177    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:23:12.830253 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.830219    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd" (OuterVolumeSpecName: "kube-api-access-smfqd") pod "9bdf297d-5192-4b2b-a8c2-e58b4b18117b" (UID: "9bdf297d-5192-4b2b-a8c2-e58b4b18117b"). InnerVolumeSpecName "kube-api-access-smfqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:12.928914 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928857    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-home\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:12.928914 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928903    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-dshm\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:12.928914 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928915    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tmp-dir\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:12.928914 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928927    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smfqd\" (UniqueName: \"kubernetes.io/projected/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-kube-api-access-smfqd\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:12.929223 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928940    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-model-cache\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:12.929223 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:12.928952    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bdf297d-5192-4b2b-a8c2-e58b4b18117b-tls-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:13.689236 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.689205    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"
Jul 18 03:23:13.689655 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.689246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4" event={"ID":"9bdf297d-5192-4b2b-a8c2-e58b4b18117b","Type":"ContainerDied","Data":"eddc271741ab0b51b8e5ef84c72281348895cf5222bfd9c1e2ef9b672a5fb3f1"}
Jul 18 03:23:13.689655 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.689298    2567 scope.go:117] "RemoveContainer" containerID="26e3006347b35a3e49bd6d1d8ad34fa82f024bc9f00061b0fd00e78c4d6da0b5"
Jul 18 03:23:13.710159 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.710132    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:23:13.713581 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.713555    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b50cfd/rate-test-model-b50cfd-kserve-6db4f845f5-xrmb4"]
Jul 18 03:23:13.776586 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.776556    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" path="/var/lib/kubelet/pods/9bdf297d-5192-4b2b-a8c2-e58b4b18117b/volumes"
Jul 18 03:23:13.824918 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.824893    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:13.833723 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.833697    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p476\" (UniqueName: \"kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476\") pod \"af1d550f-6ef4-492b-83f7-508302555305\" (UID: \"af1d550f-6ef4-492b-83f7-508302555305\") "
Jul 18 03:23:13.835721 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.835698    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476" (OuterVolumeSpecName: "kube-api-access-4p476") pod "af1d550f-6ef4-492b-83f7-508302555305" (UID: "af1d550f-6ef4-492b-83f7-508302555305"). InnerVolumeSpecName "kube-api-access-4p476". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:13.843288 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.843266    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312655841440_af1d550f-6ef4-492b-83f7-508302555305/test-curl-7447-140312655841440/0.log"
Jul 18 03:23:13.865465 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.865440    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:13.869068 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.869048    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:13.934736 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.934704    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p476\" (UniqueName: \"kubernetes.io/projected/af1d550f-6ef4-492b-83f7-508302555305-kube-api-access-4p476\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:13.991424 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991347    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:13.991695 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991683    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" containerName="main"
Jul 18 03:23:13.991740 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991696    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" containerName="main"
Jul 18 03:23:13.991740 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991713    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1d550f-6ef4-492b-83f7-508302555305" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:13.991740 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991718    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1d550f-6ef4-492b-83f7-508302555305" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:13.991833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991772    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bdf297d-5192-4b2b-a8c2-e58b4b18117b" containerName="main"
Jul 18 03:23:13.991833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.991779    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1d550f-6ef4-492b-83f7-508302555305" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:13.994753 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:13.994737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.001193 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.001172    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:14.035893 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.035859    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxsbr\" (UniqueName: \"kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr\") pod \"test-curl-7447-140312655841440\" (UID: \"b4001bf3-055c-40ac-8aff-1dc5aac6095d\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.137264 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.137230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxsbr\" (UniqueName: \"kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr\") pod \"test-curl-7447-140312655841440\" (UID: \"b4001bf3-055c-40ac-8aff-1dc5aac6095d\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.145722 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.145700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxsbr\" (UniqueName: \"kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr\") pod \"test-curl-7447-140312655841440\" (UID: \"b4001bf3-055c-40ac-8aff-1dc5aac6095d\") " pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.304830 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.304750    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.455964 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.455820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:14.458553 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:14.458525    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4001bf3_055c_40ac_8aff_1dc5aac6095d.slice/crio-c0f3872dd42eb90a155635b19d7ed519802d88cae10cfe89c963186d0d918d48 WatchSource:0}: Error finding container c0f3872dd42eb90a155635b19d7ed519802d88cae10cfe89c963186d0d918d48: Status 404 returned error can't find the container with id c0f3872dd42eb90a155635b19d7ed519802d88cae10cfe89c963186d0d918d48
Jul 18 03:23:14.695742 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.695716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655841440" event={"ID":"b4001bf3-055c-40ac-8aff-1dc5aac6095d","Type":"ContainerStarted","Data":"c0f3872dd42eb90a155635b19d7ed519802d88cae10cfe89c963186d0d918d48"}
Jul 18 03:23:14.697457 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.697439    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="841399308d2e89a99f1505343e9c5d7d1987f849025b66b276d8c3bd853490f4"
Jul 18 03:23:14.697593 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.697472    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:14.707967 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:14.707944    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7447-140312655841440" oldPodUID="af1d550f-6ef4-492b-83f7-508302555305" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d"
Jul 18 03:23:15.704415 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:15.704383    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" containerID="adcf707678fdc41d7a5235cde62787523dcb759458367ed4d7d8b832f00f8155" exitCode=0
Jul 18 03:23:15.704790 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:15.704439    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140312655841440" event={"ID":"b4001bf3-055c-40ac-8aff-1dc5aac6095d","Type":"ContainerDied","Data":"adcf707678fdc41d7a5235cde62787523dcb759458367ed4d7d8b832f00f8155"}
Jul 18 03:23:15.773749 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:15.773718    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1d550f-6ef4-492b-83f7-508302555305" path="/var/lib/kubelet/pods/af1d550f-6ef4-492b-83f7-508302555305/volumes"
Jul 18 03:23:16.840889 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.840865    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:16.857423 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.857396    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxsbr\" (UniqueName: \"kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr\") pod \"b4001bf3-055c-40ac-8aff-1dc5aac6095d\" (UID: \"b4001bf3-055c-40ac-8aff-1dc5aac6095d\") "
Jul 18 03:23:16.859892 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.859863    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr" (OuterVolumeSpecName: "kube-api-access-xxsbr") pod "b4001bf3-055c-40ac-8aff-1dc5aac6095d" (UID: "b4001bf3-055c-40ac-8aff-1dc5aac6095d"). InnerVolumeSpecName "kube-api-access-xxsbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:23:16.860153 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.860136    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140312655841440_b4001bf3-055c-40ac-8aff-1dc5aac6095d/test-curl-7447-140312655841440/0.log"
Jul 18 03:23:16.883448 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.883427    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:16.886953 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.886933    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140312655841440"]
Jul 18 03:23:16.958609 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:16.958586    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxsbr\" (UniqueName: \"kubernetes.io/projected/b4001bf3-055c-40ac-8aff-1dc5aac6095d-kube-api-access-xxsbr\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:17.065167 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.065101    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"]
Jul 18 03:23:17.065433 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.065421    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:17.065471 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.065435    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:17.065518 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.065509    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" containerName="test-curl-7447-140312655841440"
Jul 18 03:23:17.071778 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.071097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:17.073585 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.073562    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:23:17.074381 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.073718    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:23:17.076492 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.076469    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"]
Jul 18 03:23:17.160082 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.160048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e88910-t74wt\" (UID: \"fc65ee93-cc34-49f4-a052-fc4ce31d53fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:17.260685 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.260652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e88910-t74wt\" (UID: \"fc65ee93-cc34-49f4-a052-fc4ce31d53fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:17.261228 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.261212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e88910-t74wt\" (UID: \"fc65ee93-cc34-49f4-a052-fc4ce31d53fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:17.384018 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.383949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:17.524202 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.524179    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"]
Jul 18 03:23:17.526929 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:17.526896    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc65ee93_cc34_49f4_a052_fc4ce31d53fe.slice/crio-9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff WatchSource:0}: Error finding container 9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff: Status 404 returned error can't find the container with id 9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff
Jul 18 03:23:17.541002 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.540957    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:17.642008 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.641904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:17.716463 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.716428    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:17.716463 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.716452    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0f3872dd42eb90a155635b19d7ed519802d88cae10cfe89c963186d0d918d48"
Jul 18 03:23:17.717709 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.717683    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt" event={"ID":"fc65ee93-cc34-49f4-a052-fc4ce31d53fe","Type":"ContainerStarted","Data":"9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff"}
Jul 18 03:23:17.726069 ip-10-0-136-56 kubenswrapper[2567]: E0718 03:23:17.726044    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140312655841440\" is forbidden: User \"system:node:ip-10-0-136-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-56.ec2.internal' and this object" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" pod="opendatahub/test-curl-7447-140312655841440"
Jul 18 03:23:17.773966 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:17.773943    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4001bf3-055c-40ac-8aff-1dc5aac6095d" path="/var/lib/kubelet/pods/b4001bf3-055c-40ac-8aff-1dc5aac6095d/volumes"
Jul 18 03:23:18.724435 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:18.724402    2567 generic.go:356] "Generic (PLEG): container finished" podID="fc65ee93-cc34-49f4-a052-fc4ce31d53fe" containerID="fddcef607f2416b6fbb9ed42928978afe303cc3f9098fbb24345a4088033f23a" exitCode=0
Jul 18 03:23:18.724870 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:18.724488    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt" event={"ID":"fc65ee93-cc34-49f4-a052-fc4ce31d53fe","Type":"ContainerDied","Data":"fddcef607f2416b6fbb9ed42928978afe303cc3f9098fbb24345a4088033f23a"}
Jul 18 03:23:19.860852 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:19.860825    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:19.879182 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:19.879156    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca\") pod \"fc65ee93-cc34-49f4-a052-fc4ce31d53fe\" (UID: \"fc65ee93-cc34-49f4-a052-fc4ce31d53fe\") "
Jul 18 03:23:19.879475 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:19.879456    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc65ee93-cc34-49f4-a052-fc4ce31d53fe" (UID: "fc65ee93-cc34-49f4-a052-fc4ce31d53fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:23:19.979834 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:19.979799    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc65ee93-cc34-49f4-a052-fc4ce31d53fe-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:20.735567 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:20.735533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt" event={"ID":"fc65ee93-cc34-49f4-a052-fc4ce31d53fe","Type":"ContainerDied","Data":"9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff"}
Jul 18 03:23:20.735567 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:20.735566    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"
Jul 18 03:23:20.735790 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:20.735585    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9514f96a2049a74b6a9896e1b81b2ae33b2d9d91558c5d75aff168ab693a54ff"
Jul 18 03:23:27.443634 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:27.443513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:30.680360 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:30.680318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:23:32.127310 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:32.127268    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:32.140970 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:32.140940    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"]
Jul 18 03:23:32.143665 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:32.143643    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e88910-t74wt"]
Jul 18 03:23:32.536483 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:32.536406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:33.641642 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:33.641606    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:33.741007 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:33.740959    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:33.773623 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:33.773589    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc65ee93-cc34-49f4-a052-fc4ce31d53fe" path="/var/lib/kubelet/pods/fc65ee93-cc34-49f4-a052-fc4ce31d53fe/volumes"
Jul 18 03:23:38.189645 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.189612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:38.244298 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.244260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:38.461903 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.461815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:38.712258 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.712177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:38.833944 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.833850    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"]
Jul 18 03:23:38.834209 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.834195    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc65ee93-cc34-49f4-a052-fc4ce31d53fe" containerName="revoke-keys"
Jul 18 03:23:38.834209 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.834210    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc65ee93-cc34-49f4-a052-fc4ce31d53fe" containerName="revoke-keys"
Jul 18 03:23:38.834348 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.834293    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc65ee93-cc34-49f4-a052-fc4ce31d53fe" containerName="revoke-keys"
Jul 18 03:23:38.839929 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.839907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:38.842954 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.842928    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 03:23:38.843100 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.842954    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dghrk\""
Jul 18 03:23:38.844266 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.844241    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"]
Jul 18 03:23:38.938049 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:38.938015    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl\" (UID: \"1f1db587-6d36-4246-93a6-7a0d48dd99e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:39.038807 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.038726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl\" (UID: \"1f1db587-6d36-4246-93a6-7a0d48dd99e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:39.039343 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.039326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl\" (UID: \"1f1db587-6d36-4246-93a6-7a0d48dd99e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:39.153083 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.153049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:39.285574 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.285545    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"]
Jul 18 03:23:39.288315 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:23:39.288276    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1db587_6d36_4246_93a6_7a0d48dd99e7.slice/crio-9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3 WatchSource:0}: Error finding container 9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3: Status 404 returned error can't find the container with id 9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3
Jul 18 03:23:39.317243 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.317221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:39.417836 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.417804    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:39.822757 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.822665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl" event={"ID":"1f1db587-6d36-4246-93a6-7a0d48dd99e7","Type":"ContainerStarted","Data":"77e8c6a9a4ca0fb8a3af3685b5960dda206a72666e574f4e5cc86c637de81af8"}
Jul 18 03:23:39.822757 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.822720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl" event={"ID":"1f1db587-6d36-4246-93a6-7a0d48dd99e7","Type":"ContainerStarted","Data":"9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3"}
Jul 18 03:23:39.837122 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:39.837069    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl" podStartSLOduration=1.8370542699999999 podStartE2EDuration="1.83705427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:23:39.835932286 +0000 UTC m=+2616.487983987" watchObservedRunningTime="2026-07-18 03:23:39.83705427 +0000 UTC m=+2616.489105970"
Jul 18 03:23:40.829389 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:40.829356    2567 generic.go:356] "Generic (PLEG): container finished" podID="1f1db587-6d36-4246-93a6-7a0d48dd99e7" containerID="77e8c6a9a4ca0fb8a3af3685b5960dda206a72666e574f4e5cc86c637de81af8" exitCode=0
Jul 18 03:23:40.829775 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:40.829427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl" event={"ID":"1f1db587-6d36-4246-93a6-7a0d48dd99e7","Type":"ContainerDied","Data":"77e8c6a9a4ca0fb8a3af3685b5960dda206a72666e574f4e5cc86c637de81af8"}
Jul 18 03:23:41.963657 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:41.963636    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:42.062732 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.062700    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca\") pod \"1f1db587-6d36-4246-93a6-7a0d48dd99e7\" (UID: \"1f1db587-6d36-4246-93a6-7a0d48dd99e7\") "
Jul 18 03:23:42.063151 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.063119    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f1db587-6d36-4246-93a6-7a0d48dd99e7" (UID: "1f1db587-6d36-4246-93a6-7a0d48dd99e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:23:42.163711 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.163674    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1db587-6d36-4246-93a6-7a0d48dd99e7-maas-api-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\""
Jul 18 03:23:42.840399 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.840362    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"
Jul 18 03:23:42.840568 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.840404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl" event={"ID":"1f1db587-6d36-4246-93a6-7a0d48dd99e7","Type":"ContainerDied","Data":"9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3"}
Jul 18 03:23:42.840568 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:42.840444    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b22538dea6c91e941075b27edbe5ae1abbe413e46317e8523521da7423906e3"
Jul 18 03:23:49.367247 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:49.367205    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:52.576484 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:52.576447    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g8lp9"]
Jul 18 03:23:53.903925 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:53.903886    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:53.904356 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:53.904255    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"]
Jul 18 03:23:53.905693 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:53.905675    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b50cfd-ldbrl"]
Jul 18 03:23:54.274942 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:54.274851    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:23:55.773382 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:23:55.773346    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1db587-6d36-4246-93a6-7a0d48dd99e7" path="/var/lib/kubelet/pods/1f1db587-6d36-4246-93a6-7a0d48dd99e7/volumes"
Jul 18 03:24:00.047522 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:00.047490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:00.147678 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:00.147644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:00.305233 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:00.305153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:00.529571 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:00.529543    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:00.954941 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:00.954909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df88c55f9-dpd42_197ea5f2-b880-4812-a482-429f7fc08e6b/authorino/0.log"
Jul 18 03:24:07.075861 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:07.075835    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9896c96c-cdncl_7c26475a-9e26-492f-8d03-ebf9e768cb72/copy-manifests/0.log"
Jul 18 03:24:07.082616 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:07.082596    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9896c96c-cdncl_7c26475a-9e26-492f-8d03-ebf9e768cb72/manager/0.log"
Jul 18 03:24:07.810452 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:07.810423    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739075-2ll66_3230c1e0-b6f6-439e-a254-78e31c3023ec/cleanup/0.log"
Jul 18 03:24:09.192942 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:09.192913    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df88c55f9-dpd42_197ea5f2-b880-4812-a482-429f7fc08e6b/authorino/0.log"
Jul 18 03:24:09.671091 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:09.671055    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2hjcc_c0cff567-407a-41b6-a027-d0d27ac15eca/registry-server/0.log"
Jul 18 03:24:09.917044 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:09.917005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g8lp9_e503f6d7-e92f-415d-b38d-fa0250c2b007/limitador/0.log"
Jul 18 03:24:10.031645 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:10.031565    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zb7wz_5d80a710-35f6-4f06-99cd-318d1859861e/manager/0.log"
Jul 18 03:24:10.618711 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:10.618680    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58dcbd754f-jzw6l_0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0/kube-auth-proxy/0.log"
Jul 18 03:24:12.155272 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:12.155242    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bj9b8_e6910ac5-b337-40b5-b139-8baa670341fb/main/0.log"
Jul 18 03:24:17.751873 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.751832    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tn4zf/must-gather-mp7wm"]
Jul 18 03:24:17.752415 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.752395    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1db587-6d36-4246-93a6-7a0d48dd99e7" containerName="revoke-keys"
Jul 18 03:24:17.752491 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.752421    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1db587-6d36-4246-93a6-7a0d48dd99e7" containerName="revoke-keys"
Jul 18 03:24:17.752553 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.752513    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1db587-6d36-4246-93a6-7a0d48dd99e7" containerName="revoke-keys"
Jul 18 03:24:17.755911 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.755889    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.758220 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.758191    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tn4zf\"/\"openshift-service-ca.crt\""
Jul 18 03:24:17.758356 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.758231    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tn4zf\"/\"kube-root-ca.crt\""
Jul 18 03:24:17.759043 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.759027    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tn4zf\"/\"default-dockercfg-glwsz\""
Jul 18 03:24:17.764633 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.764596    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:17.764787 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.764765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsz9p\" (UniqueName: \"kubernetes.io/projected/b9563b47-5910-458c-8763-91c76c383109-kube-api-access-rsz9p\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.764883 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.764867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9563b47-5910-458c-8763-91c76c383109-must-gather-output\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.765472 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.765452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tn4zf/must-gather-mp7wm"]
Jul 18 03:24:17.835351 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.835318    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log" limit=1024
Jul 18 03:24:17.865588 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.865556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsz9p\" (UniqueName: \"kubernetes.io/projected/b9563b47-5910-458c-8763-91c76c383109-kube-api-access-rsz9p\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.865741 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.865606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9563b47-5910-458c-8763-91c76c383109-must-gather-output\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.865913 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.865898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9563b47-5910-458c-8763-91c76c383109-must-gather-output\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:17.874061 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:17.874029    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsz9p\" (UniqueName: \"kubernetes.io/projected/b9563b47-5910-458c-8763-91c76c383109-kube-api-access-rsz9p\") pod \"must-gather-mp7wm\" (UID: \"b9563b47-5910-458c-8763-91c76c383109\") " pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:18.066245 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:18.066158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tn4zf/must-gather-mp7wm"
Jul 18 03:24:18.197095 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:18.197067    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tn4zf/must-gather-mp7wm"]
Jul 18 03:24:18.199560 ip-10-0-136-56 kubenswrapper[2567]: W0718 03:24:18.199534    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9563b47_5910_458c_8763_91c76c383109.slice/crio-b9b8c8ff9e99628036e4e6c7cd1cb14269df915423a6868392bc677827b0de2a WatchSource:0}: Error finding container b9b8c8ff9e99628036e4e6c7cd1cb14269df915423a6868392bc677827b0de2a: Status 404 returned error can't find the container with id b9b8c8ff9e99628036e4e6c7cd1cb14269df915423a6868392bc677827b0de2a
Jul 18 03:24:19.020368 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:19.020328    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tn4zf/must-gather-mp7wm" event={"ID":"b9563b47-5910-458c-8763-91c76c383109","Type":"ContainerStarted","Data":"b9b8c8ff9e99628036e4e6c7cd1cb14269df915423a6868392bc677827b0de2a"}
Jul 18 03:24:20.029370 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.029324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tn4zf/must-gather-mp7wm" event={"ID":"b9563b47-5910-458c-8763-91c76c383109","Type":"ContainerStarted","Data":"e733380df6e2df6e23b096f1d184d9803ea63b7a99cf3d9b99c18694abe0379c"}
Jul 18 03:24:20.029878 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.029405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tn4zf/must-gather-mp7wm" event={"ID":"b9563b47-5910-458c-8763-91c76c383109","Type":"ContainerStarted","Data":"7f9ba3d857e3c5f2ce0a29b551970606212b431b749d356fc25502cbe6857344"}
Jul 18 03:24:20.044935 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.044877    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tn4zf/must-gather-mp7wm" podStartSLOduration=2.05985583 podStartE2EDuration="3.044855056s" totalImagesPullingTime="984.999226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:24:20.043883812 +0000 UTC m=+2656.695935535" watchObservedRunningTime="2026-07-18 03:24:20.044855056 +0000 UTC m=+2656.696906756"
Jul 18 03:24:20.752628 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.752600    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pzv7t_876d7772-11d2-41b6-89a0-aa42c6bd9e0a/global-pull-secret-syncer/0.log"
Jul 18 03:24:20.806550 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.806520    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8xm9b_bfe3d93e-7d71-49f5-9369-d246f147fd83/konnectivity-agent/0.log"
Jul 18 03:24:20.920181 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:20.920147    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-56.ec2.internal_296182ac9f69666f6c3b613faa7d2ac3/haproxy/0.log"
Jul 18 03:24:26.028007 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:26.027109    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6df88c55f9-dpd42_197ea5f2-b880-4812-a482-429f7fc08e6b/authorino/0.log"
Jul 18 03:24:26.154339 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:26.154203    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2hjcc_c0cff567-407a-41b6-a027-d0d27ac15eca/registry-server/0.log"
Jul 18 03:24:26.345189 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:26.345117    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g8lp9_e503f6d7-e92f-415d-b38d-fa0250c2b007/limitador/0.log"
Jul 18 03:24:26.424443 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:26.424404    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zb7wz_5d80a710-35f6-4f06-99cd-318d1859861e/manager/0.log"
Jul 18 03:24:28.307616 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.307584    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7rpvl_ad49cae8-eba7-40d1-bad5-7e484970f8cf/kube-state-metrics/0.log"
Jul 18 03:24:28.322593 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.322497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7rpvl_ad49cae8-eba7-40d1-bad5-7e484970f8cf/kube-rbac-proxy-main/0.log"
Jul 18 03:24:28.342630 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.342594    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7rpvl_ad49cae8-eba7-40d1-bad5-7e484970f8cf/kube-rbac-proxy-self/0.log"
Jul 18 03:24:28.433716 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.433672    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29n7v_b656138f-3754-4f7a-be3a-43f522e81e61/node-exporter/0.log"
Jul 18 03:24:28.450326 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.450297    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29n7v_b656138f-3754-4f7a-be3a-43f522e81e61/kube-rbac-proxy/0.log"
Jul 18 03:24:28.468412 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.468385    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29n7v_b656138f-3754-4f7a-be3a-43f522e81e61/init-textfile/0.log"
Jul 18 03:24:28.626268 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.626132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwv8s_33243675-6aa1-43d9-85b2-59ee84ef8228/kube-rbac-proxy-main/0.log"
Jul 18 03:24:28.646526 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.646501    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwv8s_33243675-6aa1-43d9-85b2-59ee84ef8228/kube-rbac-proxy-self/0.log"
Jul 18 03:24:28.665736 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.665706    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bwv8s_33243675-6aa1-43d9-85b2-59ee84ef8228/openshift-state-metrics/0.log"
Jul 18 03:24:28.717008 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.715825    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/prometheus/0.log"
Jul 18 03:24:28.755386 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.755354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/config-reloader/0.log"
Jul 18 03:24:28.779009 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.778942    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/thanos-sidecar/0.log"
Jul 18 03:24:28.800362 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.800336    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/kube-rbac-proxy-web/0.log"
Jul 18 03:24:28.821385 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.821360    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/kube-rbac-proxy/0.log"
Jul 18 03:24:28.844161 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.844130    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/kube-rbac-proxy-thanos/0.log"
Jul 18 03:24:28.873054 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.873023    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1156d2c6-f9fa-46b4-9197-169f88837cec/init-config-reloader/0.log"
Jul 18 03:24:28.944833 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:28.944739    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jcrxp_9202b5c1-b436-4644-a399-7d58563cf023/prometheus-operator-admission-webhook/0.log"
Jul 18 03:24:29.045729 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.045697    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/thanos-query/0.log"
Jul 18 03:24:29.064191 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.064162    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/kube-rbac-proxy-web/0.log"
Jul 18 03:24:29.083612 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.083581    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/kube-rbac-proxy/0.log"
Jul 18 03:24:29.102762 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.102733    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/prom-label-proxy/0.log"
Jul 18 03:24:29.122244 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.122207    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/kube-rbac-proxy-rules/0.log"
Jul 18 03:24:29.140411 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:29.140378    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5994bbbbd5-jsb8l_397579a0-0100-4ea0-80be-3320701cf482/kube-rbac-proxy-metrics/0.log"
Jul 18 03:24:31.172555 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.172523    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"]
Jul 18 03:24:31.181337 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.181308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.185352 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.185317    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"]
Jul 18 03:24:31.301762 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.301726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-podres\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.302095 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.302077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-sys\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.302254 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.302239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-proc\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.302429 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.302412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc89s\" (UniqueName: \"kubernetes.io/projected/93748f0c-63c1-4777-90a9-b3918f84ed56-kube-api-access-gc89s\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.302564 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.302551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-lib-modules\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403788 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403736    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-podres\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-sys\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-proc\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc89s\" (UniqueName: \"kubernetes.io/projected/93748f0c-63c1-4777-90a9-b3918f84ed56-kube-api-access-gc89s\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-podres\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.403973 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.403959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-lib-modules\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.404312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.404104    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-proc\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.404312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.404112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-lib-modules\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.404312 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.404156    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93748f0c-63c1-4777-90a9-b3918f84ed56-sys\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.412076 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.412043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc89s\" (UniqueName: \"kubernetes.io/projected/93748f0c-63c1-4777-90a9-b3918f84ed56-kube-api-access-gc89s\") pod \"perf-node-gather-daemonset-vmldk\" (UID: \"93748f0c-63c1-4777-90a9-b3918f84ed56\") " pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.497662 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.497568    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:31.584379 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.584348    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-bntwv_47c69a13-f6e6-452b-b87d-b34c40b564ce/download-server/0.log"
Jul 18 03:24:31.678626 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:31.678588    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"]
Jul 18 03:24:32.116765 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:32.116723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk" event={"ID":"93748f0c-63c1-4777-90a9-b3918f84ed56","Type":"ContainerStarted","Data":"97e69ceeae50edf6123780e5170ded2682b6779189abfe8e2938ba7ae37be645"}
Jul 18 03:24:32.116968 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:32.116789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk" event={"ID":"93748f0c-63c1-4777-90a9-b3918f84ed56","Type":"ContainerStarted","Data":"7d56f03db5a3492afa862488576a4f5e3fb427db4df48e02bf068d8678584e51"}
Jul 18 03:24:32.117300 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:32.117277    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:32.134388 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:32.132689    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk" podStartSLOduration=1.132670731 podStartE2EDuration="1.132670731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:24:32.131059378 +0000 UTC m=+2668.783111081" watchObservedRunningTime="2026-07-18 03:24:32.132670731 +0000 UTC m=+2668.784722436"
Jul 18 03:24:33.207781 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:33.207758    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wjn5v_81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6/dns/0.log"
Jul 18 03:24:33.225745 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:33.225631    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wjn5v_81aecfa1-abc8-4c71-9eaf-3e735ec5f8d6/kube-rbac-proxy/0.log"
Jul 18 03:24:33.266436 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:33.266395    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-thfh5_45dbdde2-9cdb-41ba-8f14-f38fd703c3e0/dns-node-resolver/0.log"
Jul 18 03:24:33.842380 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:33.842353    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82k4d_20ac3396-02b9-4b5f-9d47-7ad6fa2b7a5b/node-ca/0.log"
Jul 18 03:24:35.007348 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:35.007318    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58dcbd754f-jzw6l_0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0/kube-auth-proxy/0.log"
Jul 18 03:24:35.902465 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:35.902440    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lvfnm_ecb5e8ec-0a6a-4a53-9ceb-0266de781b38/serve-healthcheck-canary/0.log"
Jul 18 03:24:36.454821 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:36.454794    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdhgd_6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7/kube-rbac-proxy/0.log"
Jul 18 03:24:36.473644 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:36.473613    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdhgd_6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7/exporter/0.log"
Jul 18 03:24:36.492235 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:36.492206    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vdhgd_6bc2b8e4-0718-4aa4-ab82-f64f7355aaf7/extractor/0.log"
Jul 18 03:24:38.138149 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:38.137478    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tn4zf/perf-node-gather-daemonset-vmldk"
Jul 18 03:24:39.331897 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:39.331864    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9896c96c-cdncl_7c26475a-9e26-492f-8d03-ebf9e768cb72/manager/0.log"
Jul 18 03:24:39.349920 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:39.349889    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9896c96c-cdncl_7c26475a-9e26-492f-8d03-ebf9e768cb72/copy-manifests/0.log"
Jul 18 03:24:40.893608 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:40.893527    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59945b78f9-5kwj2_947fdcd8-59cb-4647-ac50-9d06d1314213/manager/0.log"
Jul 18 03:24:41.821387 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:41.821358    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58dcbd754f-jzw6l_0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0/kube-auth-proxy/0.log"
Jul 18 03:24:43.497067 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:43.496975    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58dcbd754f-jzw6l_0ba62ef0-7dfb-41fc-8b55-4842f79d8fc0/kube-auth-proxy/0.log"
Jul 18 03:24:45.990289 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:45.990249    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-krxjb_2ddfb342-c8e2-41e0-9384-828c2ffe89ef/migrator/0.log"
Jul 18 03:24:46.007787 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:46.007759    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-krxjb_2ddfb342-c8e2-41e0-9384-828c2ffe89ef/graceful-termination/0.log"
Jul 18 03:24:47.479528 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.479497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/kube-multus-additional-cni-plugins/0.log"
Jul 18 03:24:47.497706 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.497681    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/egress-router-binary-copy/0.log"
Jul 18 03:24:47.515618 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.515598    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/cni-plugins/0.log"
Jul 18 03:24:47.532974 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.532955    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/bond-cni-plugin/0.log"
Jul 18 03:24:47.553214 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.553192    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/routeoverride-cni/0.log"
Jul 18 03:24:47.573127 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.573100    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/whereabouts-cni-bincopy/0.log"
Jul 18 03:24:47.591293 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.591269    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbs54_bd042130-da2c-4cc3-a783-d1e8cf320610/whereabouts-cni/0.log"
Jul 18 03:24:47.902610 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.902582    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m44rf_01374b45-7dac-42c7-a581-e8779a60b45f/kube-multus/0.log"
Jul 18 03:24:47.921959 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.921930    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jstt2_2df05729-ccdd-45b2-b326-38cbe1d50f6d/network-metrics-daemon/0.log"
Jul 18 03:24:47.938218 ip-10-0-136-56 kubenswrapper[2567]: I0718 03:24:47.938199    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jstt2_2df05729-ccdd-45b2-b326-38cbe1d50f6d/kube-rbac-proxy/0.log"