Jul 08 06:54:59.743923 ip-10-0-136-197 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.234026    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240420    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240434    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240438    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240445    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240450    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240454    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240457    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.311269 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240460    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240463    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240468    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240472    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240475    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240478    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240481    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240485    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240488    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240491    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240493    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240506    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240516    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240519    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240522    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240525    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240529    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240531    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240534    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240537    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.312172 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240540    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240543    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240546    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240548    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240551    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240556    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240558    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240561    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240564    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240567    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240570    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240573    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240576    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240578    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240581    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240584    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240587    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240589    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240592    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240595    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.312860 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240597    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240600    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240602    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240606    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240609    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240611    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240614    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240617    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240620    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240623    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240626    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240629    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240632    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240635    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240638    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240641    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240644    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240647    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240649    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240652    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.313516 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240655    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240658    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240660    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240663    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240666    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240669    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240672    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240687    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240690    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240693    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240696    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240699    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240702    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240705    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240711    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240714    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240719    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240722    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240725    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240728    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.314140 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240731    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240734    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240737    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240740    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240742    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240745    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240748    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240750    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240753    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240756    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240758    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.240761    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241564    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241572    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241575    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241579    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241582    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241586    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241589    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.314730 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241593    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241596    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241600    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241603    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241607    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241610    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241613    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241616    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241618    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241621    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241625    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241629    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241632    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241635    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241638    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241641    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241644    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241647    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241649    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241652    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.315304 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241655    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241658    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241661    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241665    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241667    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241670    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241690    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241695    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241699    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241702    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241705    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241708    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241711    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241715    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241719    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241722    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241726    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241729    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.315930 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241733    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241737    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241740    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241743    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241746    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241750    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241753    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241756    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241759    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241762    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241765    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241768    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241771    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241774    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241777    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241780    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241782    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241785    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241789    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241792    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.316487 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241795    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241798    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241801    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241804    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241807    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241810    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241813    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241815    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241818    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241821    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241824    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241826    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241829    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241832    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241834    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241837    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241840    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241842    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241846    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241848    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.317097 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241851    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241854    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241856    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241859    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241862    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241865    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241868    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241870    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241873    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241876    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241879    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241882    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241885    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.241888    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242328    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242333    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242337    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242340    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242343    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242346    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.317722 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242349    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242352    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242355    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242357    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242360    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242363    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242366    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242369    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242371    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242374    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242378    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242380    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242383    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242386    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242389    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242391    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242394    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242397    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242401    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242405    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.318606 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242408    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242411    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242414    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242418    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242421    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242423    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242426    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242429    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242432    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242436    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242439    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242442    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242445    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242448    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242452    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242455    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242459    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242462    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242465    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.319431 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242467    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242470    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242473    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242476    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242479    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242481    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242484    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242487    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242489    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242492    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242495    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242497    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242500    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242503    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242507    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242511    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242515    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242519    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242522    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.417411 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242526    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.333608 ip-10-0-136-197 systemd[1]: Started Kubernetes Kubelet.
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242529    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242532    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242536    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242543    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242546    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242549    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242552    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242555    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242557    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242560    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242563    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242566    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242569    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242571    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242574    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242577    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242579    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242583    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242585    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.418157 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242588    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242591    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242594    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242597    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242599    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242602    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242607    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242610    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242613    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242615    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242618    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242621    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242623    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242626    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.242629    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242735    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242748    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242755    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242760    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242765    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242769    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 06:55:00.418957 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242773    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242778    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242782    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242785    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242789    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242792    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242796    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242799    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242802    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242806    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242810    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242813    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242819    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242822    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242825    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242828    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242832    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242838    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242841    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242844    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242848    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242852    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242855    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242859    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 06:55:00.419669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242862    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242865    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242870    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242875    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242878    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242881    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242884    2575 flags.go:64] FLAG: --enable-server="true"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242887    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242892    2575 flags.go:64] FLAG: --event-burst="100"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242895    2575 flags.go:64] FLAG: --event-qps="50"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242898    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242902    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242905    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242909    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242912    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242916    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242919    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242922    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242925    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242928    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242932    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242935    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242938    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242941    2575 flags.go:64] FLAG: --feature-gates=""
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242944    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 06:55:00.420421 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242949    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242952    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242956    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242959    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242962    2575 flags.go:64] FLAG: --help="false"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242966    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242970    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242973    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242976    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242980    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242985    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242988    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242991    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242994    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.242998    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243001    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243004    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243007    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243010    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243013    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243017    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243020    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243023    2575 flags.go:64] FLAG: --lock-file=""
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243026    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 06:55:00.421264 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243030    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243033    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243039    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243042    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243045    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243048    2575 flags.go:64] FLAG: --logging-format="text"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243051    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243055    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243059    2575 flags.go:64] FLAG: --manifest-url=""
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243062    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243067    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243070    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243075    2575 flags.go:64] FLAG: --max-pods="110"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243078    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243081    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243084    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243087    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243090    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243095    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243098    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243105    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243109    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243112    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 06:55:00.422015 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243115    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243118    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243124    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243128    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243131    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243134    2575 flags.go:64] FLAG: --port="10250"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243137    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243140    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a9a68185f175cf6"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243144    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243147    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243150    2575 flags.go:64] FLAG: --register-node="true"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243153    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243157    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243160    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243164    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243167    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243170    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243175    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243178    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243182    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243185    2575 flags.go:64] FLAG: --runonce="false"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243188    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243191    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243194    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243197    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 06:55:00.422805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243201    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243204    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243208    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243212    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243215    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243218    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243221    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243225    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243228    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243231    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243235    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243240    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243244    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243247    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243251    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243254    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243258    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243261    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243264    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243267    2575 flags.go:64] FLAG: --v="2"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243271    2575 flags.go:64] FLAG: --version="false"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243276    2575 flags.go:64] FLAG: --vmodule=""
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243280    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.243284    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243429    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.423557 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243433    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243437    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243440    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243443    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243446    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243449    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243453    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243456    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243458    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243461    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243465    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243468    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243471    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243474    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243477    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243480    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243483    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243486    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243489    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243491    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.424343 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243495    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243498    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243500    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243503    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243506    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243509    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243511    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243514    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243517    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.243574    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245041    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245061    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245068    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245074    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245079    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245085    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245092    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245097    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245109    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245115    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.424983 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245119    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245127    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245144    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245149    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245153    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245158    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245162    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245167    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245171    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245175    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245180    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245184    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245189    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245193    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245198    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245207    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245212    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245217    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245222    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245227    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.425653 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245231    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245236    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245244    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245248    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245252    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245257    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245261    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245271    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245276    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245280    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245285    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245289    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245294    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245299    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245306    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245330    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245336    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245370    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245486    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245493    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.426254 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245496    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245499    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245501    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245504    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245508    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245511    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245514    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245519    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245523    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245527    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245531    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245534    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245537    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245540    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245545    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245549    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245554    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.426923 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.245557    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.246320    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.254165    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.254188    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.254211    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.254218    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254290    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254296    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254299    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254303    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254306    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254310    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254313    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254316    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254319    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.427596 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254322    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254325    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254328    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254331    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254334    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254337    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254340    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254343    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254347    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254349    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254353    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254356    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254359    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254361    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254364    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254370    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254373    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254376    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254379    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254383    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.428257 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254385    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254388    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254391    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254394    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254397    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254400    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254402    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254405    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254408    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254410    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254414    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254417    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254420    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254422    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254425    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254428    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254431    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254434    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254437    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254440    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.428928 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254442    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254447    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254451    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254455    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254458    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254461    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254464    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254468    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254471    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254475    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254479    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254484    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254487    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254490    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254493    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254495    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254499    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254501    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254504    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.429587 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254507    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254509    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254513    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254516    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254519    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254521    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254524    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254528    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254530    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254533    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254536    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254539    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254542    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254545    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254550    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254552    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254555    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254558    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254561    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254564    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.430235 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254570    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254573    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254576    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254580    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254584    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254587    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254590    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254593    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254596    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254599    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254602    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.254608    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254761    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254767    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:00.430888 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254770    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254773    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254776    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254779    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254782    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254785    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254787    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254790    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254793    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254796    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254799    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254802    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254807    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254810    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254813    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254816    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254818    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254821    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254824    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254828    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:00.431783 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254831    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254834    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254837    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254839    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254842    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254845    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254848    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254850    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254853    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254856    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254859    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254863    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254867    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254870    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254873    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254876    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254878    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254881    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254884    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:00.640189 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254887    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254889    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254892    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254895    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254897    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254903    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254908    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254911    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254914    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254917    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254920    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254923    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254927    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254929    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254932    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254935    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254938    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254941    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254944    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254947    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:00.662520 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254950    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254952    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254955    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254958    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254961    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254964    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254967    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254970    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254973    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254975    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254978    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254981    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254984    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254987    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254990    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254992    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254995    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.254999    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255002    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255005    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:00.663200 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255007    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255012    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255015    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255018    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255023    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255026    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255029    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255032    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255035    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255038    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255040    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255043    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255046    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255049    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255051    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255054    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255057    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:00.663832 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:00.255060    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.255066    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.255228    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.257889    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.259976    2575 server.go:1019] "Starting client certificate rotation"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.260087    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.260131    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.263719    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.266197    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.285643    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.289516    2575 log.go:25] "Validated CRI v1 image API"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.296027    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:55:00.664386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.297047    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 06:55:00.664806 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.300085    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8a33e7ea-cb5d-41ff-a5c8-e1b3b829fd58:/dev/nvme0n1p4 958c8e58-9e88-45b8-b463-7cb232570577:/dev/nvme0n1p3]
Jul 08 06:55:00.664806 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.300103    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.305473    2575 manager.go:216] Machine: {Timestamp:2026-07-08 06:55:00.304057846 +0000 UTC m=+0.422813656 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105797 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e42c813e1037cbf05a34e037777c0 SystemUUID:ec2e42c8-13e1-037c-bf05-a34e037777c0 BootID:1dfae704-1558-4a31-9702-f4334107b687 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:c1:4f:1c:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:c1:4f:1c:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:28:0e:70:be:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.305601    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.305711    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.310212    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.310248    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.311244    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.311259    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.311270    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.311958    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.313784    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318534    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318693    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318728    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318744    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318757    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318769    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.318779    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 06:55:00.664992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.319285    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.319313    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.322067    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.324740    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.324781    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326301    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326319    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326328    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326336    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326348    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326357    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326369    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326377    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326387    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326395    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326407    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.326416    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.328663    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.328689    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.329240    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5gd4"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.330888    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.330934    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.331096    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.332845    2575 server.go:1268] "Started kubelet"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.333332    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.335757    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.343416    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.343510    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.343662    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5gd4"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.346412    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.348823    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351044    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351047    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.351173    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351813    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351826    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351955    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.351964    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352064    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352251    2575 factory.go:153] Registering CRI-O factory
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352265    2575 factory.go:223] Registration of the crio container factory successfully
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352334    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352344    2575 factory.go:55] Registering systemd factory
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352353    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352375    2575 factory.go:103] Registering Raw factory
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.352389    2575 manager.go:1196] Started watching for new ooms in manager
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.353076    2575 manager.go:349] Starting recovery of all containers
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.363136    2575 manager.go:354] Recovery completed
Jul 08 06:55:00.665618 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.363157    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.366753    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-197.ec2.internal\" not found" node="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.372706    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.375531    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.375566    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.375581    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.376227    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.376242    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.376264    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.376270    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377287    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377316    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377329    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377778    2575 policy_none.go:49] "None policy: Start"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377795    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.377807    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.378980    2575 policy_none.go:47] "Start"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.440483    2575 manager.go:337] "Starting Device Plugin manager"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.440516    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.440529    2575 server.go:87] "Starting device plugin registration server"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.440819    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.440834    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.440969    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.441063    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.441070    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.441618    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.441665    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.541816    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.542861    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.542897    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.542914    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.542944    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.551634    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.551660    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-197.ec2.internal\": node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.571194    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.578066    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.579394    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.579433    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.579463    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.579507    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 06:55:00.667073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.582897    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.672399    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.680072    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"]
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.680152    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.682212    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.682243    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.682253    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.683904    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684047    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684078    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684689    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684712    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684726    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684748    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684767    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.684780    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.686356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.686382    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.687122    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.687158    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.687170    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.716371    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-197.ec2.internal\" not found" node="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.721426    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-197.ec2.internal\" not found" node="ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.757141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.757170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.757196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d945e716ad71445b8b512961502b0cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"d945e716ad71445b8b512961502b0cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.772740    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.867995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.869055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d945e716ad71445b8b512961502b0cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"d945e716ad71445b8b512961502b0cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.869055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858302    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d945e716ad71445b8b512961502b0cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"d945e716ad71445b8b512961502b0cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.869055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858312    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:00.869055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:00.858328    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8ed39f6d40277e17300b68adbabf9a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"f8ed39f6d40277e17300b68adbabf9a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:01.076184 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.873390    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:01.076184 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:00.973740    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:01.076184 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.023701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:01.076184 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.026800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:01.076184 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:01.074507    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:01.285294 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:01.175575    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:01.285294 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.258525    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 06:55:01.285294 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.258716    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:55:01.285294 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.258716    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:55:01.285294 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:01.276226    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.335477    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.351551    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.351556    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.352030    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 06:50:00 +0000 UTC" deadline="2028-03-25 12:16:33.097970942 +0000 UTC"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.352054    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15029h21m31.745920482s"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.362228    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.364402    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.365078    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.374686    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.387852    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kvk4"
Jul 08 06:55:01.455961 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.396248    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kvk4"
Jul 08 06:55:01.838743 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:01.638102    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd945e716ad71445b8b512961502b0cbc.slice/crio-8171c232d01891e6831404803ee794995ebc4914a5cbd67faa608d3df96a93e6 WatchSource:0}: Error finding container 8171c232d01891e6831404803ee794995ebc4914a5cbd67faa608d3df96a93e6: Status 404 returned error can't find the container with id 8171c232d01891e6831404803ee794995ebc4914a5cbd67faa608d3df96a93e6
Jul 08 06:55:01.838743 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:01.638515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ed39f6d40277e17300b68adbabf9a2.slice/crio-66e937b8b68ffb2e2e6246c04aa1838c68eaad7543ab56224c84f705abed3efd WatchSource:0}: Error finding container 66e937b8b68ffb2e2e6246c04aa1838c68eaad7543ab56224c84f705abed3efd: Status 404 returned error can't find the container with id 66e937b8b68ffb2e2e6246c04aa1838c68eaad7543ab56224c84f705abed3efd
Jul 08 06:55:01.838743 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.643537    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 06:55:01.838743 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:01.691595    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:02.333367 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.320127    2575 apiserver.go:52] "Watching apiserver"
Jul 08 06:55:02.333367 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.331619    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 06:55:02.333367 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.332111    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m","openshift-cluster-node-tuning-operator/tuned-55vzr","openshift-multus/multus-6glws","openshift-multus/multus-additional-cni-plugins-jqkg5","openshift-multus/network-metrics-daemon-4vz9q","openshift-network-operator/iptables-alerter-9jmhw","kube-system/global-pull-secret-syncer-skqwb","openshift-dns/node-resolver-k4hct","openshift-image-registry/node-ca-zqxfd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal","openshift-network-diagnostics/network-check-target-w7pwd","openshift-ovn-kubernetes/ovnkube-node-ctjb4","kube-system/konnectivity-agent-prr5j"]
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.334114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.335643    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.337086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.337626    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.337627    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.338033    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b5dcr\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.338245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.338793    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.339542    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.339821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8rpm5\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.339890    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.340013    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h87g2\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.340251    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.340929    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.341143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.341325    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.341711    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sfs2c\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.341926    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.343058    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.344097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.344177    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.345520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.347038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.347104    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.348400    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.348577    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.348652    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.348704    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xjhlf\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.350024    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.351915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.352822    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.353079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j7l9v\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.353126    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.417476 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.353584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.353660    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.355238    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.355441    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tmtc8\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.355483    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.355787    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.356025    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.357944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.359131    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.359331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.359402    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hjdjl\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.361050    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.362095    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.362461    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.362461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g752g\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.362845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.363012    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.363166    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.368846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.368924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pxf\" (UniqueName: \"kubernetes.io/projected/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-kube-api-access-68pxf\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9d0d000-b483-46a4-a0ec-f4b2def312ce-host\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452a1aec-bbf8-46ff-9742-4af49a2252c0-tmp-dir\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-lib-modules\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-etc-kubernetes\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.419386 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-sys-fs\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-kubelet-config\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw84z\" (UniqueName: \"kubernetes.io/projected/452a1aec-bbf8-46ff-9742-4af49a2252c0-kube-api-access-mw84z\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-os-release\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-modprobe-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.369982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklwp\" (UniqueName: \"kubernetes.io/projected/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-kube-api-access-vklwp\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-cnibin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-multus-certs\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-socket-dir-parent\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-k8s-cni-cncf-io\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452a1aec-bbf8-46ff-9742-4af49a2252c0-hosts-file\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-host-slash\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-dbus\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9z4\" (UniqueName: \"kubernetes.io/projected/b9d0d000-b483-46a4-a0ec-f4b2def312ce-kube-api-access-sw9z4\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysconfig\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.420863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-cni-binary-copy\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8spl\" (UniqueName: \"kubernetes.io/projected/fa9f2f45-a6b7-4140-b3e8-901947a626d0-kube-api-access-k8spl\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9d0d000-b483-46a4-a0ec-f4b2def312ce-serviceca\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cj9\" (UniqueName: \"kubernetes.io/projected/e6628049-8079-4b83-a503-b1e420812d90-kube-api-access-48cj9\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-system-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-run\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzp8\" (UniqueName: \"kubernetes.io/projected/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-kube-api-access-wjzp8\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-hostroot\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-multus-daemon-config\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-system-cni-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-tuned\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlnd7\" (UniqueName: \"kubernetes.io/projected/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kube-api-access-tlnd7\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-systemd\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-bin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-conf\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-conf-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-kubernetes\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-sys\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-tmp\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cnibin\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-iptables-alerter-script\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-device-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-host\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.370990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-multus\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-kubelet\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.422944 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-socket-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-registration-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-var-lib-kubelet\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-netns\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.371147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-os-release\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.395833    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.398304    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:50:01 +0000 UTC" deadline="2027-12-11 15:26:01.746860332 +0000 UTC"
Jul 08 06:55:02.424075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.398350    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12512h30m59.348514103s"
Jul 08 06:55:02.453778 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.453749    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 06:55:02.471990 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.471940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-sys\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-tmp\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-sys\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cnibin\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-iptables-alerter-script\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cnibin\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.472193    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-device-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.472269    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:02.972245615 +0000 UTC m=+3.091001411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-device-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-host\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-multus\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-kubelet\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-socket-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-host\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.472625 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472415    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-registration-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovn-node-metrics-cert\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-kubelet\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472471    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-multus\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-var-lib-kubelet\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472527    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-registration-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472514    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-netns\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472582    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-socket-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-os-release\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472657    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-netns\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472645    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-var-lib-kubelet\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472734    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-os-release\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-bin\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472794    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-iptables-alerter-script\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.473372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pxf\" (UniqueName: \"kubernetes.io/projected/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-kube-api-access-68pxf\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9d0d000-b483-46a4-a0ec-f4b2def312ce-host\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472841    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452a1aec-bbf8-46ff-9742-4af49a2252c0-tmp-dir\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472890    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9d0d000-b483-46a4-a0ec-f4b2def312ce-host\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-lib-modules\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-etc-kubernetes\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.472977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-sys-fs\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-ovn\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-kubelet-config\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw84z\" (UniqueName: \"kubernetes.io/projected/452a1aec-bbf8-46ff-9742-4af49a2252c0-kube-api-access-mw84z\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-os-release\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-modprobe-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklwp\" (UniqueName: \"kubernetes.io/projected/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-kube-api-access-vklwp\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473166    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452a1aec-bbf8-46ff-9742-4af49a2252c0-tmp-dir\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.474055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-node-log\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-cnibin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-multus-certs\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-log-socket\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-socket-dir-parent\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-k8s-cni-cncf-io\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef00ac94-5ede-42c9-945a-f43d3e914a92-agent-certs\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.473395    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452a1aec-bbf8-46ff-9742-4af49a2252c0-hosts-file\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-host-slash\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-dbus\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473500    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-os-release\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9z4\" (UniqueName: \"kubernetes.io/projected/b9d0d000-b483-46a4-a0ec-f4b2def312ce-kube-api-access-sw9z4\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-systemd-units\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473543    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-modprobe-d\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-script-lib\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.474931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysconfig\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473599    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-lib-modules\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473615    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-netd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452a1aec-bbf8-46ff-9742-4af49a2252c0-hosts-file\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ac94-5ede-42c9-945a-f43d3e914a92-konnectivity-ca\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-cnibin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473200    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-kubelet-config\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.473749    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:02.973727519 +0000 UTC m=+3.092483317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473701    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-multus-certs\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473826    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-sys-fs\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473860    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-etc-kubernetes\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473880    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-host-slash\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473911    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysconfig\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473941    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-socket-dir-parent\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-cni-binary-copy\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.475634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.473992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8spl\" (UniqueName: \"kubernetes.io/projected/fa9f2f45-a6b7-4140-b3e8-901947a626d0-kube-api-access-k8spl\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9d0d000-b483-46a4-a0ec-f4b2def312ce-serviceca\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-netns\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474099    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06c0c990-684b-4c63-b72c-14ca0f92f66c-dbus\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cj9\" (UniqueName: \"kubernetes.io/projected/e6628049-8079-4b83-a503-b1e420812d90-kube-api-access-48cj9\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-kubelet\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-run-k8s-cni-cncf-io\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-var-lib-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-system-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-run\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzp8\" (UniqueName: \"kubernetes.io/projected/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-kube-api-access-wjzp8\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-hostroot\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-multus-daemon-config\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-cni-binary-copy\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-system-cni-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.476458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-tuned\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlnd7\" (UniqueName: \"kubernetes.io/projected/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kube-api-access-tlnd7\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474713    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9d0d000-b483-46a4-a0ec-f4b2def312ce-serviceca\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-etc-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-env-overrides\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-systemd\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-system-cni-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-bin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474851    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-run\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474904    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9f2f45-a6b7-4140-b3e8-901947a626d0-system-cni-dir\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474947    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-hostroot\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.474975    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-systemd\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475004    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-host-var-lib-cni-bin\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.477229 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-conf\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-conf-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-slash\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-systemd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-config\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s559\" (UniqueName: \"kubernetes.io/projected/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-kube-api-access-6s559\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-kubernetes\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6628049-8079-4b83-a503-b1e420812d90-multus-daemon-config\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475604    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-kubernetes\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475683    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6628049-8079-4b83-a503-b1e420812d90-multus-conf-dir\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475764    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.475895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-sysctl-conf\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.476013    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9f2f45-a6b7-4140-b3e8-901947a626d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.476935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-tmp\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.477985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.477834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-etc-tuned\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.484996 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.483859    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:02.484996 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.483883    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:02.484996 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.483898    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:02.484996 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.483963    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:02.983949576 +0000 UTC m=+3.102705369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:02.486758 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.486695    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw84z\" (UniqueName: \"kubernetes.io/projected/452a1aec-bbf8-46ff-9742-4af49a2252c0-kube-api-access-mw84z\") pod \"node-resolver-k4hct\" (UID: \"452a1aec-bbf8-46ff-9742-4af49a2252c0\") " pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.487869 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.487846    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzp8\" (UniqueName: \"kubernetes.io/projected/fb56b3db-aa4e-4ddd-a98d-fa075f61a7db-kube-api-access-wjzp8\") pod \"tuned-55vzr\" (UID: \"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db\") " pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.488310 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.488284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8spl\" (UniqueName: \"kubernetes.io/projected/fa9f2f45-a6b7-4140-b3e8-901947a626d0-kube-api-access-k8spl\") pod \"multus-additional-cni-plugins-jqkg5\" (UID: \"fa9f2f45-a6b7-4140-b3e8-901947a626d0\") " pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.488826 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.488802    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9z4\" (UniqueName: \"kubernetes.io/projected/b9d0d000-b483-46a4-a0ec-f4b2def312ce-kube-api-access-sw9z4\") pod \"node-ca-zqxfd\" (UID: \"b9d0d000-b483-46a4-a0ec-f4b2def312ce\") " pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.488960 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.488824    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pxf\" (UniqueName: \"kubernetes.io/projected/4b3b5d5d-5e57-43b6-b2fd-671938eb3e09-kube-api-access-68pxf\") pod \"iptables-alerter-9jmhw\" (UID: \"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09\") " pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.489114 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.488952    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cj9\" (UniqueName: \"kubernetes.io/projected/e6628049-8079-4b83-a503-b1e420812d90-kube-api-access-48cj9\") pod \"multus-6glws\" (UID: \"e6628049-8079-4b83-a503-b1e420812d90\") " pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.489887 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.489842    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlnd7\" (UniqueName: \"kubernetes.io/projected/d1ce57ce-7679-4679-b3a5-de88a33a6ffe-kube-api-access-tlnd7\") pod \"aws-ebs-csi-driver-node-ccq4m\" (UID: \"d1ce57ce-7679-4679-b3a5-de88a33a6ffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.491121 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.491009    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklwp\" (UniqueName: \"kubernetes.io/projected/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-kube-api-access-vklwp\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.576949 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.576907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.576961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-slash\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-systemd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-config\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577035    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-slash\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577052    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s559\" (UniqueName: \"kubernetes.io/projected/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-kube-api-access-6s559\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-systemd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovn-node-metrics-cert\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-bin\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-ovn\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-node-log\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-log-socket\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef00ac94-5ede-42c9-945a-f43d3e914a92-agent-certs\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-systemd-units\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-script-lib\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577404    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-systemd-units\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577414    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-node-log\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-log-socket\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-netd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-bin\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ac94-5ede-42c9-945a-f43d3e914a92-konnectivity-ca\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577519    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-cni-netd\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577568    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-run-ovn\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.577627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-netns\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-kubelet\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577679    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-config\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-var-lib-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577732    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-var-lib-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-etc-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577754    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-kubelet\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-env-overrides\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577813    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-run-netns\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577871    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.577878    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-etc-openvswitch\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.578209    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ac94-5ede-42c9-945a-f43d3e914a92-konnectivity-ca\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.578255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovnkube-script-lib\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.578463 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.578264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-env-overrides\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.580362 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.580330    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-ovn-node-metrics-cert\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.580648 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.580604    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef00ac94-5ede-42c9-945a-f43d3e914a92-agent-certs\") pod \"konnectivity-agent-prr5j\" (UID: \"ef00ac94-5ede-42c9-945a-f43d3e914a92\") " pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.585025 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.584939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"f8ed39f6d40277e17300b68adbabf9a2","Type":"ContainerStarted","Data":"66e937b8b68ffb2e2e6246c04aa1838c68eaad7543ab56224c84f705abed3efd"}
Jul 08 06:55:02.586653 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.586625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" event={"ID":"d945e716ad71445b8b512961502b0cbc","Type":"ContainerStarted","Data":"8171c232d01891e6831404803ee794995ebc4914a5cbd67faa608d3df96a93e6"}
Jul 08 06:55:02.588011 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.587989    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s559\" (UniqueName: \"kubernetes.io/projected/7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3-kube-api-access-6s559\") pod \"ovnkube-node-ctjb4\" (UID: \"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.648076 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.648042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m"
Jul 08 06:55:02.657995 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.657971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55vzr"
Jul 08 06:55:02.670160 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.670078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6glws"
Jul 08 06:55:02.677220 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.677196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqkg5"
Jul 08 06:55:02.686166 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.686144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jmhw"
Jul 08 06:55:02.696113 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.696092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4hct"
Jul 08 06:55:02.705040 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.705011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqxfd"
Jul 08 06:55:02.713297 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.713273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:02.719289 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.719268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:02.827935 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.827901    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:02.981369 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.981291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:02.981369 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:02.981340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:02.981534 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.981440    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:02.981534 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.981443    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:02.981534 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.981502    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:03.981486733 +0000 UTC m=+4.100242542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:02.981534 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:02.981517    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:03.981509761 +0000 UTC m=+4.100265554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:03.082272 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.082233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:03.082499 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.082474    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:03.082560 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.082507    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:03.082560 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.082529    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:03.082679 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.082614    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:04.082588942 +0000 UTC m=+4.201344756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:03.399199 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.399086    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:50:01 +0000 UTC" deadline="2027-12-04 07:14:02.615283975 +0000 UTC"
Jul 08 06:55:03.399199 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.399142    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h18m59.216145502s"
Jul 08 06:55:03.580819 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.580786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:03.580819 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.580822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:03.581432 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.580926    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:03.581432 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.581114    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:03.695916 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:03.695866    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d0d000_b483_46a4_a0ec_f4b2def312ce.slice/crio-e3790b1d8e595fca926dd39aa0e2d46b55137fbe312652b544002b68df1346c1 WatchSource:0}: Error finding container e3790b1d8e595fca926dd39aa0e2d46b55137fbe312652b544002b68df1346c1: Status 404 returned error can't find the container with id e3790b1d8e595fca926dd39aa0e2d46b55137fbe312652b544002b68df1346c1
Jul 08 06:55:03.698899 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:03.698823    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb56b3db_aa4e_4ddd_a98d_fa075f61a7db.slice/crio-b9e0279a2764ea2dd218c7f33f8af7f6906d0cafd3b2b4ba79a07238e98c60d9 WatchSource:0}: Error finding container b9e0279a2764ea2dd218c7f33f8af7f6906d0cafd3b2b4ba79a07238e98c60d9: Status 404 returned error can't find the container with id b9e0279a2764ea2dd218c7f33f8af7f6906d0cafd3b2b4ba79a07238e98c60d9
Jul 08 06:55:03.703750 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:03.703326    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3b5d5d_5e57_43b6_b2fd_671938eb3e09.slice/crio-724b49e38765ab15351dcaebed4c165500f69c67942bac6ba5c6b5b62deec489 WatchSource:0}: Error finding container 724b49e38765ab15351dcaebed4c165500f69c67942bac6ba5c6b5b62deec489: Status 404 returned error can't find the container with id 724b49e38765ab15351dcaebed4c165500f69c67942bac6ba5c6b5b62deec489
Jul 08 06:55:03.707553 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:03.707234    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3c3f2a_bc18_43ab_9fe1_d097af1e5ea3.slice/crio-29f1865972188b3ddd40c2aad319b2016dc80493d9ffb5ee1d4728ab96b04722 WatchSource:0}: Error finding container 29f1865972188b3ddd40c2aad319b2016dc80493d9ffb5ee1d4728ab96b04722: Status 404 returned error can't find the container with id 29f1865972188b3ddd40c2aad319b2016dc80493d9ffb5ee1d4728ab96b04722
Jul 08 06:55:03.715530 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:03.715505    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9f2f45_a6b7_4140_b3e8_901947a626d0.slice/crio-a55a4678141fbe159dedde7f0e879a38a11448c7fea60ccc6e3fca980c4a1744 WatchSource:0}: Error finding container a55a4678141fbe159dedde7f0e879a38a11448c7fea60ccc6e3fca980c4a1744: Status 404 returned error can't find the container with id a55a4678141fbe159dedde7f0e879a38a11448c7fea60ccc6e3fca980c4a1744
Jul 08 06:55:03.988613 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.988438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:03.988613 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.988600    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:03.988853 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:03.988641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:03.988853 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.988671    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:05.988655399 +0000 UTC m=+6.107411191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:03.988853 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.988745    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:03.988853 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:03.988796    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:05.988780794 +0000 UTC m=+6.107536607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:04.089075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.089024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:04.089250 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:04.089222    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:04.089250 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:04.089249    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:04.089366 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:04.089263    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:04.089366 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:04.089326    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:06.08930655 +0000 UTC m=+6.208062361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:04.582620 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.582536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:04.583123 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:04.582660    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:04.602583 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.602543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" event={"ID":"d945e716ad71445b8b512961502b0cbc","Type":"ContainerStarted","Data":"94bf64adc646c62800d3579010a177b24cd2f58ae5c4bdd07f79591218d7c2df"}
Jul 08 06:55:04.626880 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.626366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jmhw" event={"ID":"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09","Type":"ContainerStarted","Data":"724b49e38765ab15351dcaebed4c165500f69c67942bac6ba5c6b5b62deec489"}
Jul 08 06:55:04.629793 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.629764    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55vzr" event={"ID":"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db","Type":"ContainerStarted","Data":"b9e0279a2764ea2dd218c7f33f8af7f6906d0cafd3b2b4ba79a07238e98c60d9"}
Jul 08 06:55:04.642714 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.642645    2575 generic.go:356] "Generic (PLEG): container finished" podID="f8ed39f6d40277e17300b68adbabf9a2" containerID="49128464f3f10acde41e8c7c8c61638ab564edabd117797c8b8bbaac5fd1de24" exitCode=0
Jul 08 06:55:04.642869 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.642795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"f8ed39f6d40277e17300b68adbabf9a2","Type":"ContainerDied","Data":"49128464f3f10acde41e8c7c8c61638ab564edabd117797c8b8bbaac5fd1de24"}
Jul 08 06:55:04.658695 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.656038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"29f1865972188b3ddd40c2aad319b2016dc80493d9ffb5ee1d4728ab96b04722"}
Jul 08 06:55:04.658822 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.658757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerStarted","Data":"a55a4678141fbe159dedde7f0e879a38a11448c7fea60ccc6e3fca980c4a1744"}
Jul 08 06:55:04.661294 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.659977    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" podStartSLOduration=3.6599584480000003 podStartE2EDuration="3.659958448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:04.624558704 +0000 UTC m=+4.743314522" watchObservedRunningTime="2026-07-08 06:55:04.659958448 +0000 UTC m=+4.778714264"
Jul 08 06:55:04.662769 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.662625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prr5j" event={"ID":"ef00ac94-5ede-42c9-945a-f43d3e914a92","Type":"ContainerStarted","Data":"d223394e80ab2e9c7d1668c09ceb7b18c9c462fbb4b74e545ba6e2431ec8063c"}
Jul 08 06:55:04.673205 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.673172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m" event={"ID":"d1ce57ce-7679-4679-b3a5-de88a33a6ffe","Type":"ContainerStarted","Data":"b0361d4275bdc5e63894cf98ceea4b994597c4bea309484d3e14e4f0967dc2ff"}
Jul 08 06:55:04.687708 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.687609    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4hct" event={"ID":"452a1aec-bbf8-46ff-9742-4af49a2252c0","Type":"ContainerStarted","Data":"ca7a441c97c7ef4037af4930024fcbf634246add73c606b93d7f07a70d486170"}
Jul 08 06:55:04.698420 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.698347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6glws" event={"ID":"e6628049-8079-4b83-a503-b1e420812d90","Type":"ContainerStarted","Data":"98ed014745c0424b2b1bde358e98280c5e69b0a592adf794f30573b7f09d5e75"}
Jul 08 06:55:04.713311 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:04.713271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqxfd" event={"ID":"b9d0d000-b483-46a4-a0ec-f4b2def312ce","Type":"ContainerStarted","Data":"e3790b1d8e595fca926dd39aa0e2d46b55137fbe312652b544002b68df1346c1"}
Jul 08 06:55:05.580661 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:05.580601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:05.580880 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:05.580759    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:05.581194 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:05.581170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:05.581323 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:05.581300    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:05.733434 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:05.733322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"f8ed39f6d40277e17300b68adbabf9a2","Type":"ContainerStarted","Data":"1e58a735103b387cec2362ac0b98d8d1fbda3cdf44d7348d177028f03ab57c75"}
Jul 08 06:55:06.004571 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:06.004484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:06.004778 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:06.004584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:06.004778 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.004734    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:06.004889 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.004803    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:10.004783586 +0000 UTC m=+10.123539382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:06.005530 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.005426    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:06.005530 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.005485    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:10.005469669 +0000 UTC m=+10.124225467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:06.106442 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:06.105554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:06.106442 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.105890    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:06.106442 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.105914    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:06.106442 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.105928    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:06.106442 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.105991    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:10.105971574 +0000 UTC m=+10.224727370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:06.580228 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:06.580189    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:06.580411 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:06.580343    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:07.580136 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:07.580105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:07.580708 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:07.580223    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:07.580708 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:07.580228    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:07.580708 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:07.580310    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:08.580922 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:08.580764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:08.581358 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:08.580941    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:09.580075 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:09.579977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:09.580268 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:09.580105    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:09.580268 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:09.580140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:09.580268 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:09.580182    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:10.039652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:10.039743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.039831    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.039850    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.039907    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:18.039888825 +0000 UTC m=+18.158644627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:10.040000 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.039925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:18.039915494 +0000 UTC m=+18.158671284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:10.141166 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:10.140899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:10.141166 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.141066    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:10.141166 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.141089    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:10.141166 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.141103    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:10.141166 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.141161    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:18.141142403 +0000 UTC m=+18.259898196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:10.581888 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:10.581403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:10.581888 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:10.581517    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:11.580677 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:11.580191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:11.580677 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:11.580216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:11.580677 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:11.580321    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:11.580677 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:11.580399    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:12.580732 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:12.580696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:12.581285 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:12.580841    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:13.580663 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:13.580632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:13.580844 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:13.580647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:13.581189 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:13.581137    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:13.581346 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:13.581319    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:14.580627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:14.580594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:14.580742 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:14.580725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:15.580189 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:15.580148    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:15.580189 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:15.580184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:15.580635 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:15.580272    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:15.580635 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:15.580386    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:16.580288 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:16.580252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:16.580783 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:16.580390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:17.580250 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:17.580211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:17.580250 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:17.580257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:17.580788 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:17.580355    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:17.580788 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:17.580478    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:18.099407 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:18.099369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:18.099593 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:18.099437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:18.099593 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.099533    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:18.099720 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.099617    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:34.099584705 +0000 UTC m=+34.218340496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:18.099720 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.099540    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:18.099720 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.099652    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:55:34.099643779 +0000 UTC m=+34.218399570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:18.200699 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:18.200647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:18.200850 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.200822    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:18.200850 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.200845    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:18.200943 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.200855    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:18.200943 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.200910    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:34.200895485 +0000 UTC m=+34.319651292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:18.580245 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:18.580159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:18.580411 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:18.580334    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:19.579979 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:19.579948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:19.580385 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:19.580071    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:19.580385 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:19.580135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:19.580385 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:19.580249    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:20.580764 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:20.580726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:20.581226 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:20.580844    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:21.580570 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:21.580531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:21.580768 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:21.580532    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:21.580768 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:21.580682    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:21.580768 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:21.580718    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:22.580766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:22.580726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:22.581055 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:22.580877    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:23.580068 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.579753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:23.580249 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.579800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:23.580249 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:23.580165    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:23.580367 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:23.580322    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:23.778742 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.778707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prr5j" event={"ID":"ef00ac94-5ede-42c9-945a-f43d3e914a92","Type":"ContainerStarted","Data":"98e1ac516005ff5571c0137f90182ab907820b61ed99a69bca106c248f5d61c0"}
Jul 08 06:55:23.780029 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.779999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m" event={"ID":"d1ce57ce-7679-4679-b3a5-de88a33a6ffe","Type":"ContainerStarted","Data":"1fd993a4818a87ec66603d81551a752b13cfc7e70052322905ad05a80ecb69fe"}
Jul 08 06:55:23.781331 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.781308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4hct" event={"ID":"452a1aec-bbf8-46ff-9742-4af49a2252c0","Type":"ContainerStarted","Data":"890d375784e69d2579452e034bc3e34cc73ff9414e63d15b502b4e9d3265963b"}
Jul 08 06:55:23.782795 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.782771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6glws" event={"ID":"e6628049-8079-4b83-a503-b1e420812d90","Type":"ContainerStarted","Data":"2f8ae11e9d100bbec91031541fdbfc6a33a5f7c6045b498a9dc8d4d1215f01e6"}
Jul 08 06:55:23.784035 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.784008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqxfd" event={"ID":"b9d0d000-b483-46a4-a0ec-f4b2def312ce","Type":"ContainerStarted","Data":"c2362d5eebed4ae47d6cc2020cb617e3e4d566026798729064110e1fef44398c"}
Jul 08 06:55:23.785404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.785385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55vzr" event={"ID":"fb56b3db-aa4e-4ddd-a98d-fa075f61a7db","Type":"ContainerStarted","Data":"1267713b136c6b8126ea62e426feeb8935672c3617f40249bd1eb1971b3f6964"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"4cd9cb1e0632ec098d2c3ae378c33bedf2d92b187ba31e048f604c957807d3e9"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788663    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"99f81e24478adf28d5326a762eeb5f0277c1cb96307eb427c4efb10ce6494f52"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"33fd6e4065a5a18ae83469e552c88b7c7b9cc45d89cd9ff48b1748da5ca7dd2c"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788749    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"5b6b8ca2c6adbc4be62101bb66f1c7f86037e10c330a5afbbdebe918ff895106"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"0fcd3be20d50982e70d9b0c7a29ae33dc979bf71d2a786e3634404806149f3f9"}
Jul 08 06:55:23.789124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.788832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"4870cf73a946339ca2151d8f4b8d765e235c47286a85f905d250db4b2d0a90ce"}
Jul 08 06:55:23.790624 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.790587    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="0d4c6f7353852f07bd539f9a810c0fef2cbe84de0e1673d4c15ec71b250eef4e" exitCode=0
Jul 08 06:55:23.790711 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.790627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"0d4c6f7353852f07bd539f9a810c0fef2cbe84de0e1673d4c15ec71b250eef4e"}
Jul 08 06:55:23.798594 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.798561    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" podStartSLOduration=22.798549881 podStartE2EDuration="22.798549881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:05.751604503 +0000 UTC m=+5.870360346" watchObservedRunningTime="2026-07-08 06:55:23.798549881 +0000 UTC m=+23.917305694"
Jul 08 06:55:23.798821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.798799    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-prr5j" podStartSLOduration=11.923268972 podStartE2EDuration="22.798792726s" totalImagesPullingTime="10.875523754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:23.798437981 +0000 UTC m=+23.917193796" watchObservedRunningTime="2026-07-08 06:55:23.798792726 +0000 UTC m=+23.917548538"
Jul 08 06:55:23.813288 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.813252    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k4hct" podStartSLOduration=3.843742561 podStartE2EDuration="22.813244523s" totalImagesPullingTime="18.969501962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:23.812913766 +0000 UTC m=+23.931669579" watchObservedRunningTime="2026-07-08 06:55:23.813244523 +0000 UTC m=+23.932000336"
Jul 08 06:55:23.831105 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.831057    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-55vzr" podStartSLOduration=3.850667725 podStartE2EDuration="22.831044589s" totalImagesPullingTime="18.980376864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:23.830713578 +0000 UTC m=+23.949469401" watchObservedRunningTime="2026-07-08 06:55:23.831044589 +0000 UTC m=+23.949800403"
Jul 08 06:55:23.849892 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.849844    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6glws" podStartSLOduration=3.821390344 podStartE2EDuration="22.849829755s" totalImagesPullingTime="19.028439411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:23.849736617 +0000 UTC m=+23.968492429" watchObservedRunningTime="2026-07-08 06:55:23.849829755 +0000 UTC m=+23.968585568"
Jul 08 06:55:23.865459 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:23.865413    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zqxfd" podStartSLOduration=3.881205566 podStartE2EDuration="22.865397158s" totalImagesPullingTime="18.984191592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:23.865112435 +0000 UTC m=+23.983868260" watchObservedRunningTime="2026-07-08 06:55:23.865397158 +0000 UTC m=+23.984152989"
Jul 08 06:55:24.040169 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.040139    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 06:55:24.460581 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.460479    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T06:55:24.040167312Z","UUID":"6b9d09db-6d34-411d-9a5c-650ff5bf0453","Handler":null,"Name":"","Endpoint":""}
Jul 08 06:55:24.462478 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.462438    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 06:55:24.462478 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.462479    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 06:55:24.583935 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.583909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:24.584104 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:24.584037    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:24.659968 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.659924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4hct_452a1aec-bbf8-46ff-9742-4af49a2252c0/dns-node-resolver/0.log"
Jul 08 06:55:24.795452 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.795349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m" event={"ID":"d1ce57ce-7679-4679-b3a5-de88a33a6ffe","Type":"ContainerStarted","Data":"719d6f679425a6d12801e154cc7b5a43866cc5c2be65c73144e3cfb5aec6f840"}
Jul 08 06:55:24.797592 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.797563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jmhw" event={"ID":"4b3b5d5d-5e57-43b6-b2fd-671938eb3e09","Type":"ContainerStarted","Data":"3f30b85c9dd93411acd317cc09da884c9a3fa755bfabb8ee488f5811a4ab37c3"}
Jul 08 06:55:24.812462 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:24.812402    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9jmhw" podStartSLOduration=4.838301588 podStartE2EDuration="23.812383852s" totalImagesPullingTime="18.974082264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:24.811827274 +0000 UTC m=+24.930583088" watchObservedRunningTime="2026-07-08 06:55:24.812383852 +0000 UTC m=+24.931139666"
Jul 08 06:55:25.580113 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.580084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:25.580257 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.580121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:25.580257 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:25.580201    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:25.580379 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:25.580315    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:25.588630 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.588589    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:25.589251 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.589234    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:25.630359 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.630163    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqxfd_b9d0d000-b483-46a4-a0ec-f4b2def312ce/node-ca/0.log"
Jul 08 06:55:25.803793 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.803762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"0670864870c0fc55b768c8f407070ec663df3c7b6f687896c2b3640056b01f1e"}
Jul 08 06:55:25.806439 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.806359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m" event={"ID":"d1ce57ce-7679-4679-b3a5-de88a33a6ffe","Type":"ContainerStarted","Data":"13666f3946afb9c80331a7239f10a3ddbfeb0b735443d0923564bc7abf2d0ca5"}
Jul 08 06:55:25.806651 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.806617    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:25.807103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.807082    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-prr5j"
Jul 08 06:55:25.831002 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:25.830916    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccq4m" podStartSLOduration=3.84932067 podStartE2EDuration="24.830902041s" totalImagesPullingTime="20.981581371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:25.830769823 +0000 UTC m=+25.949525635" watchObservedRunningTime="2026-07-08 06:55:25.830902041 +0000 UTC m=+25.949657853"
Jul 08 06:55:26.580059 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:26.580031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:26.580270 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:26.580144    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:27.580039 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:27.580001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:27.580657 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:27.580140    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:27.580657 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:27.580197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:27.580657 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:27.580280    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:28.580295 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.580063    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:28.580934 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:28.580408    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:28.816205 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.816171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" event={"ID":"7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3","Type":"ContainerStarted","Data":"466f944f18091248ab119182aabdace876c4046744f3326d139d64a88753c4cb"}
Jul 08 06:55:28.816406 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.816383    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:28.818058 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.818030    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="8e2843bd1f4689f4331c28322a73f8bb648a9b45b9be0c63dc9f5bc0b0e5832e" exitCode=0
Jul 08 06:55:28.818186 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.818079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"8e2843bd1f4689f4331c28322a73f8bb648a9b45b9be0c63dc9f5bc0b0e5832e"}
Jul 08 06:55:28.832185 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.832134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:28.846644 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:28.846586    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4" podStartSLOduration=8.810117708 podStartE2EDuration="27.84657397s" totalImagesPullingTime="19.036456262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:28.846461985 +0000 UTC m=+28.965217799" watchObservedRunningTime="2026-07-08 06:55:28.84657397 +0000 UTC m=+28.965329784"
Jul 08 06:55:29.580158 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:29.580122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:29.580366 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:29.580123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:29.580366 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:29.580238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:29.580366 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:29.580330    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:29.820024 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:29.819993    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 06:55:29.820498 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:29.820478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:29.835966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:29.835910    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:30.298475 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:30.298392    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:55:30.580649 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:30.580557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:30.581012 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:30.580660    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:30.824254 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:30.824225    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="1c20e5dee118da77068c32891f2758cc9d5f5e3c5d723d25b1a68dfc2c756023" exitCode=0
Jul 08 06:55:30.824419 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:30.824307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"1c20e5dee118da77068c32891f2758cc9d5f5e3c5d723d25b1a68dfc2c756023"}
Jul 08 06:55:31.580309 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:31.580282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:31.580457 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:31.580283    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:31.580457 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:31.580379    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:31.580522 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:31.580463    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:32.580066 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:32.580037    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:32.580433 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:32.580128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:32.830638 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:32.830543    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="d5cc6dc550b517fe573a56ea5fe3dd85d59508b08c0112bd2cc25bffcc9b445b" exitCode=0
Jul 08 06:55:32.830638 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:32.830584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"d5cc6dc550b517fe573a56ea5fe3dd85d59508b08c0112bd2cc25bffcc9b445b"}
Jul 08 06:55:33.580465 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:33.580431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:33.580465 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:33.580462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:33.580990 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:33.580567    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:33.580990 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:33.580712    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:34.124532 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:34.124492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:34.124731 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:34.124553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:34.124731 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.124676    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:34.124731 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.124688    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:34.124894 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.124753    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs podName:01f6bcfb-15ec-4bf9-aef0-4a71484678b3 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:06.124730953 +0000 UTC m=+66.243486745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs") pod "network-metrics-daemon-4vz9q" (UID: "01f6bcfb-15ec-4bf9-aef0-4a71484678b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:34.124894 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.124779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret podName:06c0c990-684b-4c63-b72c-14ca0f92f66c nodeName:}" failed. No retries permitted until 2026-07-08 06:56:06.124760655 +0000 UTC m=+66.243516453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret") pod "global-pull-secret-syncer-skqwb" (UID: "06c0c990-684b-4c63-b72c-14ca0f92f66c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:34.224986 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:34.224946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:34.225152 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.225125    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:34.225152 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.225149    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:34.225264 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.225163    2575 projected.go:196] Error preparing data for projected volume kube-api-access-brsz6 for pod openshift-network-diagnostics/network-check-target-w7pwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:34.225264 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.225225    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6 podName:50692790-2ff1-4001-81ee-bfbe0d9e5a5d nodeName:}" failed. No retries permitted until 2026-07-08 06:56:06.22520584 +0000 UTC m=+66.343961644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-brsz6" (UniqueName: "kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6") pod "network-check-target-w7pwd" (UID: "50692790-2ff1-4001-81ee-bfbe0d9e5a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:34.580191 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:34.580104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:34.580355 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:34.580249    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:35.580685 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:35.580650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:35.581125 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:35.580650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:35.581125 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:35.580777    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:35.581125 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:35.580850    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:36.584041 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:36.584012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:36.584431 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:36.584115    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:36.584431 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:36.584193    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:36.584431 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:36.584309    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:36.842420 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:36.842343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerStarted","Data":"d37a700d962c318085a767ad8b49fabb84f972e261c03dd9c316b2aedfe4da5b"}
Jul 08 06:55:37.580036 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:37.580000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:37.580216 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:37.580111    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:37.846759 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:37.846667    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="d37a700d962c318085a767ad8b49fabb84f972e261c03dd9c316b2aedfe4da5b" exitCode=0
Jul 08 06:55:37.846759 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:37.846736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"d37a700d962c318085a767ad8b49fabb84f972e261c03dd9c316b2aedfe4da5b"}
Jul 08 06:55:38.582805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:38.582771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:38.582990 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:38.582865    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:38.582990 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:38.582919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:38.583110 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:38.583025    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:38.852419 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:38.852341    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa9f2f45-a6b7-4140-b3e8-901947a626d0" containerID="ed34eec2008a0477e730160e4d6d56c8e3ed4faba0142855efddc104abbc1bc5" exitCode=0
Jul 08 06:55:38.852419 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:38.852384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerDied","Data":"ed34eec2008a0477e730160e4d6d56c8e3ed4faba0142855efddc104abbc1bc5"}
Jul 08 06:55:39.580394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:39.580355    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:39.580576 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:39.580465    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:39.857571 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:39.857492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" event={"ID":"fa9f2f45-a6b7-4140-b3e8-901947a626d0","Type":"ContainerStarted","Data":"d75611f2d22ad312f5f6a2222250d7b7a8a99a5a55a8c1db1d21daa1cf759621"}
Jul 08 06:55:39.882458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:39.882398    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jqkg5" podStartSLOduration=9.888884546 podStartE2EDuration="38.882383157s" totalImagesPullingTime="28.993498611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:39.881988317 +0000 UTC m=+40.000744131" watchObservedRunningTime="2026-07-08 06:55:39.882383157 +0000 UTC m=+40.001138969"
Jul 08 06:55:40.582928 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:40.582895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:40.583111 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:40.582895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:40.583111 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:40.582999    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:40.583111 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:40.583069    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:41.579671 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:41.579640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:41.580063 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:41.579748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:42.583078 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:42.583050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:42.583443 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:42.583052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:42.583443 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:42.583139    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:42.583443 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:42.583272    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:43.580472 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:43.580438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:43.580701 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:43.580563    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:44.580283 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:44.580248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:44.580283 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:44.580270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:44.580706 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:44.580350    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:44.580706 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:44.580478    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:45.580285 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:45.580254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:45.580501 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:45.580376    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:46.579857 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:46.579821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:46.580121 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:46.579929    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:46.580121 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:46.579985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:46.580121 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:46.580079    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:47.580525 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:47.580487    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:47.580929 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:47.580616    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:48.580546 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:48.580507    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:48.581021 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:48.580634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:48.581021 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:48.580695    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:48.581021 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:48.580802    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:49.580482 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:49.580448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:49.580681 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:49.580556    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:50.586485 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.586454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:50.587053 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.586624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:50.587053 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:50.586645    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:50.587053 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:50.586744    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:50.877182 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.877147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skqwb"]
Jul 08 06:55:50.880051 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.880012    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vz9q"]
Jul 08 06:55:50.880222 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.880095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w7pwd"]
Jul 08 06:55:50.880222 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.880199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:50.880343 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:50.880309    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:50.880694 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.880670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:50.880805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:50.880670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:50.880805 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:50.880766    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:50.880893 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:50.880854    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:52.580221 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:52.580183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:52.580815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:52.580181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:52.580815 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:52.580338    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vz9q" podUID="01f6bcfb-15ec-4bf9-aef0-4a71484678b3"
Jul 08 06:55:52.580815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:52.580376    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:52.580815 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:52.580500    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqwb" podUID="06c0c990-684b-4c63-b72c-14ca0f92f66c"
Jul 08 06:55:52.580815 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:55:52.580594    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7pwd" podUID="50692790-2ff1-4001-81ee-bfbe0d9e5a5d"
Jul 08 06:55:54.511159 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.510950    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeReady"
Jul 08 06:55:54.511490 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.511213    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 06:55:54.557917 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.557886    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8s78r"]
Jul 08 06:55:54.574074 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.574043    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swt9c"]
Jul 08 06:55:54.574252 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.574158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.577546 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.577519    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v8qhn\""
Jul 08 06:55:54.577717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.577590    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 06:55:54.577717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.577710    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 06:55:54.584507 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584490    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8s78r"]
Jul 08 06:55:54.584614 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584521    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swt9c"]
Jul 08 06:55:54.584614 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.585021 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:55:54.585021 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:55:54.585021 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.584969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:55:54.587756 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.587739    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 06:55:54.587991 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.587969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 06:55:54.588097 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.588011    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 06:55:54.589272 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlft\""
Jul 08 06:55:54.589394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 06:55:54.589394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589370    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 06:55:54.589652 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589632    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkbds\""
Jul 08 06:55:54.589744 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589637    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bhxkh\""
Jul 08 06:55:54.589744 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589640    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 06:55:54.589744 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589689    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:55:54.589744 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.589714    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:55:54.666793 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x62x\" (UniqueName: \"kubernetes.io/projected/ee4a719b-7ddc-4876-9747-b45d4bee4f13-kube-api-access-6x62x\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.666948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cda7b995-af58-4184-9b94-840fbfd5eeff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.666948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cda7b995-af58-4184-9b94-840fbfd5eeff-data-volume\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.666948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ll9\" (UniqueName: \"kubernetes.io/projected/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-api-access-k7ll9\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.666948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.667135 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.666993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a719b-7ddc-4876-9747-b45d4bee4f13-config-volume\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.667135 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.667033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a719b-7ddc-4876-9747-b45d4bee4f13-tmp-dir\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.667135 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.667069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cda7b995-af58-4184-9b94-840fbfd5eeff-crio-socket\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.667135 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.667110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a719b-7ddc-4876-9747-b45d4bee4f13-metrics-tls\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.680755 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.680724    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x25g4"]
Jul 08 06:55:54.686298 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.686283    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.694915 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.694894    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 06:55:54.695501 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.695484    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 06:55:54.696553 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.696535    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-67rsd\""
Jul 08 06:55:54.696654 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.696538    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 06:55:54.707780 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.707759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x25g4"]
Jul 08 06:55:54.767782 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cda7b995-af58-4184-9b94-840fbfd5eeff-crio-socket\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.767782 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wflg\" (UniqueName: \"kubernetes.io/projected/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-kube-api-access-6wflg\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.767782 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a719b-7ddc-4876-9747-b45d4bee4f13-metrics-tls\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x62x\" (UniqueName: \"kubernetes.io/projected/ee4a719b-7ddc-4876-9747-b45d4bee4f13-kube-api-access-6x62x\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cda7b995-af58-4184-9b94-840fbfd5eeff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cda7b995-af58-4184-9b94-840fbfd5eeff-data-volume\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767933    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cda7b995-af58-4184-9b94-840fbfd5eeff-crio-socket\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ll9\" (UniqueName: \"kubernetes.io/projected/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-api-access-k7ll9\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768047 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.767995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768362 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a719b-7ddc-4876-9747-b45d4bee4f13-config-volume\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.768362 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-cert\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.768362 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a719b-7ddc-4876-9747-b45d4bee4f13-tmp-dir\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.768362 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768241    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cda7b995-af58-4184-9b94-840fbfd5eeff-data-volume\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768543 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768470    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a719b-7ddc-4876-9747-b45d4bee4f13-tmp-dir\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.768686 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768668    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.768745 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.768717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a719b-7ddc-4876-9747-b45d4bee4f13-config-volume\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.771557 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.771537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a719b-7ddc-4876-9747-b45d4bee4f13-metrics-tls\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.771672 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.771651    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cda7b995-af58-4184-9b94-840fbfd5eeff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.777959 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.777934    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ll9\" (UniqueName: \"kubernetes.io/projected/cda7b995-af58-4184-9b94-840fbfd5eeff-kube-api-access-k7ll9\") pod \"insights-runtime-extractor-swt9c\" (UID: \"cda7b995-af58-4184-9b94-840fbfd5eeff\") " pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.778108 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.778074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x62x\" (UniqueName: \"kubernetes.io/projected/ee4a719b-7ddc-4876-9747-b45d4bee4f13-kube-api-access-6x62x\") pod \"dns-default-8s78r\" (UID: \"ee4a719b-7ddc-4876-9747-b45d4bee4f13\") " pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.868846 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.868810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-cert\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.868846 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.868852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wflg\" (UniqueName: \"kubernetes.io/projected/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-kube-api-access-6wflg\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.871214 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.871176    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-cert\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.877752 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.877730    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wflg\" (UniqueName: \"kubernetes.io/projected/9ed3e11d-cdf9-40ad-9b14-dfc0143bb592-kube-api-access-6wflg\") pod \"ingress-canary-x25g4\" (UID: \"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592\") " pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:54.884554 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.884534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8s78r"
Jul 08 06:55:54.894269 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.894245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swt9c"
Jul 08 06:55:54.994804 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:54.994768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x25g4"
Jul 08 06:55:55.070813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.070758    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8s78r"]
Jul 08 06:55:55.074098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.074026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swt9c"]
Jul 08 06:55:55.078272 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:55.078239    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda7b995_af58_4184_9b94_840fbfd5eeff.slice/crio-70659479ca433664667222ae3fa93b9a9bf9686c7354a78ff30a2e28ed4e8c8a WatchSource:0}: Error finding container 70659479ca433664667222ae3fa93b9a9bf9686c7354a78ff30a2e28ed4e8c8a: Status 404 returned error can't find the container with id 70659479ca433664667222ae3fa93b9a9bf9686c7354a78ff30a2e28ed4e8c8a
Jul 08 06:55:55.143128 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.143095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x25g4"]
Jul 08 06:55:55.146071 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:55:55.146045    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed3e11d_cdf9_40ad_9b14_dfc0143bb592.slice/crio-71bba574787293ed6994f7d2a4c9837fee81ce675e4eca8e52529dce1be9d30b WatchSource:0}: Error finding container 71bba574787293ed6994f7d2a4c9837fee81ce675e4eca8e52529dce1be9d30b: Status 404 returned error can't find the container with id 71bba574787293ed6994f7d2a4c9837fee81ce675e4eca8e52529dce1be9d30b
Jul 08 06:55:55.894849 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.894757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x25g4" event={"ID":"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592","Type":"ContainerStarted","Data":"71bba574787293ed6994f7d2a4c9837fee81ce675e4eca8e52529dce1be9d30b"}
Jul 08 06:55:55.896795 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.896731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swt9c" event={"ID":"cda7b995-af58-4184-9b94-840fbfd5eeff","Type":"ContainerStarted","Data":"70659479ca433664667222ae3fa93b9a9bf9686c7354a78ff30a2e28ed4e8c8a"}
Jul 08 06:55:55.898440 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:55.898383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s78r" event={"ID":"ee4a719b-7ddc-4876-9747-b45d4bee4f13","Type":"ContainerStarted","Data":"761ab33d21b6f8c645578c19d2797081343eab0ce6a1024e3ec210ba65375cc8"}
Jul 08 06:55:58.937680 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.937643    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:55:58.983679 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.983632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:55:58.983861 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.983753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:58.987763 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.987733    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 06:55:58.987763 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.987753    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 06:55:58.987962 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.987787    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 06:55:58.987962 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.987789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 06:55:58.989192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.989167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sv9d5\""
Jul 08 06:55:58.989527 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.989509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 06:55:58.989644 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.989507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 06:55:58.989954 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.989907    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 06:55:58.995637 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:58.995595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 06:55:59.099974 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.099941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.099974 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.099975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.100225 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.100070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.100225 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.100113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sclvd\" (UniqueName: \"kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.100225 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.100140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.100225 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.100205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.100225 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.100222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201309 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201309 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sclvd\" (UniqueName: \"kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201309 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201588 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201588 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201588 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.201588 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.201446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.202342 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.202047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.202342 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.202165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.202342 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.202185    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.202514 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.202376    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.204875 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.204853    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.204975 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.204924    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.209949 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.209924    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sclvd\" (UniqueName: \"kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd\") pod \"console-74f99ccbf4-2h4mx\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") " pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:55:59.296049 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:55:59.296014    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:56:00.572200 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.572033    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:56:00.578980 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:00.578939    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab6ec23_6ac4_434b_964c_a83f605af754.slice/crio-ed0c8f75deee03a55edf558828e97930c5bbe74aae6de568589b5617528edc83 WatchSource:0}: Error finding container ed0c8f75deee03a55edf558828e97930c5bbe74aae6de568589b5617528edc83: Status 404 returned error can't find the container with id ed0c8f75deee03a55edf558828e97930c5bbe74aae6de568589b5617528edc83
Jul 08 06:56:00.915986 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.915898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x25g4" event={"ID":"9ed3e11d-cdf9-40ad-9b14-dfc0143bb592","Type":"ContainerStarted","Data":"10b71f777739c9e2d39a5ba79d356e25af62fe883dda72d6be5fe851cc027c5c"}
Jul 08 06:56:00.917823 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.917791    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s78r" event={"ID":"ee4a719b-7ddc-4876-9747-b45d4bee4f13","Type":"ContainerStarted","Data":"3ac619bb1241e538105a364b4311e5f72ddcf053369e16a2d601c2ace7454e90"}
Jul 08 06:56:00.917974 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.917845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8s78r" event={"ID":"ee4a719b-7ddc-4876-9747-b45d4bee4f13","Type":"ContainerStarted","Data":"f9873b4c4edd53eb42b30a1399da1a9b81f19fad321f93511a53a4a67fa82c94"}
Jul 08 06:56:00.917974 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.917874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8s78r"
Jul 08 06:56:00.919023 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.918999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f99ccbf4-2h4mx" event={"ID":"aab6ec23-6ac4-434b-964c-a83f605af754","Type":"ContainerStarted","Data":"ed0c8f75deee03a55edf558828e97930c5bbe74aae6de568589b5617528edc83"}
Jul 08 06:56:00.920712 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.920691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swt9c" event={"ID":"cda7b995-af58-4184-9b94-840fbfd5eeff","Type":"ContainerStarted","Data":"33f694e30490ec14d67a6d2b51460f98712d724a580e7d9fd60bd4f83508db9a"}
Jul 08 06:56:00.931761 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.931724    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x25g4" podStartSLOduration=1.6825721329999999 podStartE2EDuration="6.931712108s" totalImagesPullingTime="5.249139975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:00.931380803 +0000 UTC m=+61.050136617" watchObservedRunningTime="2026-07-08 06:56:00.931712108 +0000 UTC m=+61.050467899"
Jul 08 06:56:00.949384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.949354    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"]
Jul 08 06:56:00.952097 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.952075    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:00.953161 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.953113    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8s78r" podStartSLOduration=1.635812798 podStartE2EDuration="6.953095275s" totalImagesPullingTime="5.317282477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:00.951566863 +0000 UTC m=+61.070322689" watchObservedRunningTime="2026-07-08 06:56:00.953095275 +0000 UTC m=+61.071851089"
Jul 08 06:56:00.955098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.954920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 06:56:00.955098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.954967    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 06:56:00.955285 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.955188    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 06:56:00.955285 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.955271    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 06:56:00.955387 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.955287    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 06:56:00.955387 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.955384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6h2fl\""
Jul 08 06:56:00.965863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:00.965845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"]
Jul 08 06:56:01.015460 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.015421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.015664 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.015555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.015727 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.015688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmd7\" (UniqueName: \"kubernetes.io/projected/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-kube-api-access-tfmd7\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.015727 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.015720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.116679 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.116652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.116821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.116720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmd7\" (UniqueName: \"kubernetes.io/projected/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-kube-api-access-tfmd7\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.116821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.116741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.116821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.116774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.117895 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.117867    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.119219 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.119191    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.119472 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.119451    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.126415 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.126392    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmd7\" (UniqueName: \"kubernetes.io/projected/11dd47e9-0f68-4de8-ad1f-58b79433fbb6-kube-api-access-tfmd7\") pod \"prometheus-operator-567f7b8b7c-lzkjv\" (UID: \"11dd47e9-0f68-4de8-ad1f-58b79433fbb6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.261503 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.261428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"
Jul 08 06:56:01.399854 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.399463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv"]
Jul 08 06:56:01.402306 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:01.402280    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11dd47e9_0f68_4de8_ad1f_58b79433fbb6.slice/crio-63fc672876a654d55b579fcf4e85fb1c4dc9ca4d7e868af9848b6e0cc007ac4f WatchSource:0}: Error finding container 63fc672876a654d55b579fcf4e85fb1c4dc9ca4d7e868af9848b6e0cc007ac4f: Status 404 returned error can't find the container with id 63fc672876a654d55b579fcf4e85fb1c4dc9ca4d7e868af9848b6e0cc007ac4f
Jul 08 06:56:01.840137 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.840109    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ctjb4"
Jul 08 06:56:01.926454 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.926407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swt9c" event={"ID":"cda7b995-af58-4184-9b94-840fbfd5eeff","Type":"ContainerStarted","Data":"0bec5ac2b2511543d4f140a02c2d2391887b9b1f3118fa74c9952447db36240d"}
Jul 08 06:56:01.928077 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:01.928033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv" event={"ID":"11dd47e9-0f68-4de8-ad1f-58b79433fbb6","Type":"ContainerStarted","Data":"63fc672876a654d55b579fcf4e85fb1c4dc9ca4d7e868af9848b6e0cc007ac4f"}
Jul 08 06:56:04.939397 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.939359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv" event={"ID":"11dd47e9-0f68-4de8-ad1f-58b79433fbb6","Type":"ContainerStarted","Data":"c71e14919a7117d92c48494f9cdb4fc233cd95c3aaf04491dacfb396e04ff80d"}
Jul 08 06:56:04.939918 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.939424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv" event={"ID":"11dd47e9-0f68-4de8-ad1f-58b79433fbb6","Type":"ContainerStarted","Data":"44565d11bd9c55af257c5677f737611ac838243175e7d60d513376299b302401"}
Jul 08 06:56:04.940935 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.940900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f99ccbf4-2h4mx" event={"ID":"aab6ec23-6ac4-434b-964c-a83f605af754","Type":"ContainerStarted","Data":"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"}
Jul 08 06:56:04.942924 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.942902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swt9c" event={"ID":"cda7b995-af58-4184-9b94-840fbfd5eeff","Type":"ContainerStarted","Data":"584b38ba9cd2bf9ff67ccbf4cb130e4b9693401cdd278bff7e531ccc284680a0"}
Jul 08 06:56:04.958030 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.957988    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-lzkjv" podStartSLOduration=1.6122314800000002 podStartE2EDuration="4.957973822s" totalImagesPullingTime="3.345742342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:04.956786684 +0000 UTC m=+65.075542497" watchObservedRunningTime="2026-07-08 06:56:04.957973822 +0000 UTC m=+65.076729688"
Jul 08 06:56:04.976874 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.976778    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swt9c" podStartSLOduration=1.492328477 podStartE2EDuration="10.976763367s" totalImagesPullingTime="9.48443489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:04.975892338 +0000 UTC m=+65.094648161" watchObservedRunningTime="2026-07-08 06:56:04.976763367 +0000 UTC m=+65.095519207"
Jul 08 06:56:04.997662 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:04.997571    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f99ccbf4-2h4mx" podStartSLOduration=2.8627616380000003 podStartE2EDuration="6.997547513s" totalImagesPullingTime="4.134785875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:04.996638185 +0000 UTC m=+65.115393998" watchObservedRunningTime="2026-07-08 06:56:04.997547513 +0000 UTC m=+65.116303327"
Jul 08 06:56:06.155872 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.155837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:56:06.156292 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.155888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:56:06.159191 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.159169    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:56:06.160559 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.160543    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:56:06.168356 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.168333    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01f6bcfb-15ec-4bf9-aef0-4a71484678b3-metrics-certs\") pod \"network-metrics-daemon-4vz9q\" (UID: \"01f6bcfb-15ec-4bf9-aef0-4a71484678b3\") " pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:56:06.168481 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.168369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06c0c990-684b-4c63-b72c-14ca0f92f66c-original-pull-secret\") pod \"global-pull-secret-syncer-skqwb\" (UID: \"06c0c990-684b-4c63-b72c-14ca0f92f66c\") " pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:56:06.256870 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.256822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:56:06.260018 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.259989    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 06:56:06.270659 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.270637    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 06:56:06.280256 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.280239    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brsz6\" (UniqueName: \"kubernetes.io/projected/50692790-2ff1-4001-81ee-bfbe0d9e5a5d-kube-api-access-brsz6\") pod \"network-check-target-w7pwd\" (UID: \"50692790-2ff1-4001-81ee-bfbe0d9e5a5d\") " pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:56:06.303325 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.303297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkbds\""
Jul 08 06:56:06.310985 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.310964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:56:06.311721 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.311673    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlft\""
Jul 08 06:56:06.313630 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.313594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqwb"
Jul 08 06:56:06.319822 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.319805    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vz9q"
Jul 08 06:56:06.464756 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.464733    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w7pwd"]
Jul 08 06:56:06.467156 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:06.467127    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50692790_2ff1_4001_81ee_bfbe0d9e5a5d.slice/crio-79be485f6be92ff516250c6928dbe0da1bb519603c4b350bb051a9142d940e35 WatchSource:0}: Error finding container 79be485f6be92ff516250c6928dbe0da1bb519603c4b350bb051a9142d940e35: Status 404 returned error can't find the container with id 79be485f6be92ff516250c6928dbe0da1bb519603c4b350bb051a9142d940e35
Jul 08 06:56:06.482199 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.482170    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skqwb"]
Jul 08 06:56:06.484781 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:06.484750    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c0c990_684b_4c63_b72c_14ca0f92f66c.slice/crio-f25e69400294dc3fb70cc689bdad82be7f950f65cf5ec9517b64954aef87393f WatchSource:0}: Error finding container f25e69400294dc3fb70cc689bdad82be7f950f65cf5ec9517b64954aef87393f: Status 404 returned error can't find the container with id f25e69400294dc3fb70cc689bdad82be7f950f65cf5ec9517b64954aef87393f
Jul 08 06:56:06.496099 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.496075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vz9q"]
Jul 08 06:56:06.498032 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:06.498011    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f6bcfb_15ec_4bf9_aef0_4a71484678b3.slice/crio-76dc3ebf5297a87c1e4bedf91443bf0f4cf49239315ad9652f87caa016b606aa WatchSource:0}: Error finding container 76dc3ebf5297a87c1e4bedf91443bf0f4cf49239315ad9652f87caa016b606aa: Status 404 returned error can't find the container with id 76dc3ebf5297a87c1e4bedf91443bf0f4cf49239315ad9652f87caa016b606aa
Jul 08 06:56:06.953333 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.953288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skqwb" event={"ID":"06c0c990-684b-4c63-b72c-14ca0f92f66c","Type":"ContainerStarted","Data":"f25e69400294dc3fb70cc689bdad82be7f950f65cf5ec9517b64954aef87393f"}
Jul 08 06:56:06.954828 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.954792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w7pwd" event={"ID":"50692790-2ff1-4001-81ee-bfbe0d9e5a5d","Type":"ContainerStarted","Data":"79be485f6be92ff516250c6928dbe0da1bb519603c4b350bb051a9142d940e35"}
Jul 08 06:56:06.955971 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:06.955948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vz9q" event={"ID":"01f6bcfb-15ec-4bf9-aef0-4a71484678b3","Type":"ContainerStarted","Data":"76dc3ebf5297a87c1e4bedf91443bf0f4cf49239315ad9652f87caa016b606aa"}
Jul 08 06:56:07.380116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.380069    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"]
Jul 08 06:56:07.384192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.384166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.388190 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.388008    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 06:56:07.388740 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.388720    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:07.389068 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.389051    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g6kxk\""
Jul 08 06:56:07.399313 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.399295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"]
Jul 08 06:56:07.411079 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.411048    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ffj6m"]
Jul 08 06:56:07.413805 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.413782    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.417004 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.416982    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pdjvj\""
Jul 08 06:56:07.417382 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.417358    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 06:56:07.417677 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.417660    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 06:56:07.417760 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.417743    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 06:56:07.436569 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.436544    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"]
Jul 08 06:56:07.439157 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.439137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.443634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.443054    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 06:56:07.443634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.443299    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:07.443634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.443517    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 06:56:07.444154 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.443976    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c97xv\""
Jul 08 06:56:07.463971 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.463939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"]
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eae69ee-f49f-4777-bb18-eaf69dd89900-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz6sj\" (UniqueName: \"kubernetes.io/projected/7ec80f09-27cd-423f-874d-c332e594a215-kube-api-access-gz6sj\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2bk6\" (UniqueName: \"kubernetes.io/projected/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-api-access-g2bk6\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.467550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzgtn\" (UniqueName: \"kubernetes.io/projected/4eae69ee-f49f-4777-bb18-eaf69dd89900-kube-api-access-nzgtn\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-root\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0f04d47b-256f-4fc7-ac8f-d87766199cd3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-wtmp\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-tls\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-sys\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-metrics-client-ca\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-textfile\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.468028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.467898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-textfile\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eae69ee-f49f-4777-bb18-eaf69dd89900-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz6sj\" (UniqueName: \"kubernetes.io/projected/7ec80f09-27cd-423f-874d-c332e594a215-kube-api-access-gz6sj\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bk6\" (UniqueName: \"kubernetes.io/projected/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-api-access-g2bk6\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzgtn\" (UniqueName: \"kubernetes.io/projected/4eae69ee-f49f-4777-bb18-eaf69dd89900-kube-api-access-nzgtn\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.569633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-root\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0f04d47b-256f-4fc7-ac8f-d87766199cd3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-wtmp\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-tls\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-sys\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-metrics-client-ca\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.570341 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.569915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.571590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.570834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-textfile\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.571590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.571134    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-root\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.571590 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:07.571247    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 08 06:56:07.571590 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:07.571305    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls podName:4eae69ee-f49f-4777-bb18-eaf69dd89900 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:08.071286756 +0000 UTC m=+68.190042547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-s69th" (UID: "4eae69ee-f49f-4777-bb18-eaf69dd89900") : secret "openshift-state-metrics-tls" not found
Jul 08 06:56:07.571590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.571392    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572033    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eae69ee-f49f-4777-bb18-eaf69dd89900-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-wtmp\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec80f09-27cd-423f-874d-c332e594a215-sys\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0f04d47b-256f-4fc7-ac8f-d87766199cd3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:07.572412    2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:07.572480    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls podName:0f04d47b-256f-4fc7-ac8f-d87766199cd3 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:08.072461915 +0000 UTC m=+68.191217711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-spzx2" (UID: "0f04d47b-256f-4fc7-ac8f-d87766199cd3") : secret "kube-state-metrics-tls" not found
Jul 08 06:56:07.572786 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec80f09-27cd-423f-874d-c332e594a215-metrics-client-ca\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.573195 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.572855    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.573529 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.573483    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.573749 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.573689    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.573883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.573862    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-tls\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.575542 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.575518    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec80f09-27cd-423f-874d-c332e594a215-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.575818 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.575791    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.585250 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.585217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzgtn\" (UniqueName: \"kubernetes.io/projected/4eae69ee-f49f-4777-bb18-eaf69dd89900-kube-api-access-nzgtn\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:07.588906 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.588881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz6sj\" (UniqueName: \"kubernetes.io/projected/7ec80f09-27cd-423f-874d-c332e594a215-kube-api-access-gz6sj\") pod \"node-exporter-ffj6m\" (UID: \"7ec80f09-27cd-423f-874d-c332e594a215\") " pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.589029 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.588920    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2bk6\" (UniqueName: \"kubernetes.io/projected/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-api-access-g2bk6\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:07.727294 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.727142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffj6m"
Jul 08 06:56:07.739387 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:07.739355    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec80f09_27cd_423f_874d_c332e594a215.slice/crio-97b8eae005de8f2dac35c9a6ade1487c3e0b59f5da14c7b356d297a9e94d91e4 WatchSource:0}: Error finding container 97b8eae005de8f2dac35c9a6ade1487c3e0b59f5da14c7b356d297a9e94d91e4: Status 404 returned error can't find the container with id 97b8eae005de8f2dac35c9a6ade1487c3e0b59f5da14c7b356d297a9e94d91e4
Jul 08 06:56:07.962939 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.962789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vz9q" event={"ID":"01f6bcfb-15ec-4bf9-aef0-4a71484678b3","Type":"ContainerStarted","Data":"ba103f0ab1876d7871deb26524b73ff5f7efccd28e58e0d8a1a27218339f7d19"}
Jul 08 06:56:07.962939 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.962856    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vz9q" event={"ID":"01f6bcfb-15ec-4bf9-aef0-4a71484678b3","Type":"ContainerStarted","Data":"37c96d32f2d67adeefb5d1bf33a93e9397271f5db56670f354e2baa03a2247e8"}
Jul 08 06:56:07.964640 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.964584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffj6m" event={"ID":"7ec80f09-27cd-423f-874d-c332e594a215","Type":"ContainerStarted","Data":"97b8eae005de8f2dac35c9a6ade1487c3e0b59f5da14c7b356d297a9e94d91e4"}
Jul 08 06:56:07.982108 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:07.982050    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vz9q" podStartSLOduration=65.867392376 podStartE2EDuration="1m6.982033696s" totalImagesPullingTime="1.11464132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:07.980671045 +0000 UTC m=+68.099426859" watchObservedRunningTime="2026-07-08 06:56:07.982033696 +0000 UTC m=+68.100789507"
Jul 08 06:56:08.073862 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.073825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:08.074042 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.073926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:08.077062 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.077032    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f04d47b-256f-4fc7-ac8f-d87766199cd3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-spzx2\" (UID: \"0f04d47b-256f-4fc7-ac8f-d87766199cd3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:08.077228 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.077201    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4eae69ee-f49f-4777-bb18-eaf69dd89900-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s69th\" (UID: \"4eae69ee-f49f-4777-bb18-eaf69dd89900\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:08.298000 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.297891    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"
Jul 08 06:56:08.351913 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.351656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"
Jul 08 06:56:08.474392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.474355    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th"]
Jul 08 06:56:08.526582 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.526491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:08.533107 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.531336    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.535403 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.534842    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 06:56:08.535403 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.535153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hdn9\""
Jul 08 06:56:08.536964 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.536595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 06:56:08.536964 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.536730    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 06:56:08.536964 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.536804    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 06:56:08.536964 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.536912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 06:56:08.542147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.540364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 06:56:08.542147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.540580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 06:56:08.542147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.540915    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 06:56:08.542147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.541146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 06:56:08.560288 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.560208    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2"]
Jul 08 06:56:08.561669 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.561642    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:08.578551 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578719 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h799\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578719 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578719 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.578891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.579096 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.579096 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.578936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.579096 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.579019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.579096 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.579058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680359 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h799\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.680839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.680754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.681372 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.681345    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.681931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.681906    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.682037 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.681984    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.682434 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:08.682412    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 08 06:56:08.682521 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:08.682493    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls podName:b157bb59-5c5e-4569-afb1-92ef6b87a678 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:09.182472741 +0000 UTC m=+69.301228547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678") : secret "alertmanager-main-tls" not found
Jul 08 06:56:08.685098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.685031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.685098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.685036    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.686183 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.685398    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.686183 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.685707    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.686183 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.685808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.686183 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.686117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.687414 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.687374    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.688194 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.688154    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.693314 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.693270    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h799\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:08.731543 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:08.731507    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eae69ee_f49f_4777_bb18_eaf69dd89900.slice/crio-e4b9abf96ece64e2d57d6d56626225593712555eb0a7a33996d4848d6a109701 WatchSource:0}: Error finding container e4b9abf96ece64e2d57d6d56626225593712555eb0a7a33996d4848d6a109701: Status 404 returned error can't find the container with id e4b9abf96ece64e2d57d6d56626225593712555eb0a7a33996d4848d6a109701
Jul 08 06:56:08.970674 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:08.970625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th" event={"ID":"4eae69ee-f49f-4777-bb18-eaf69dd89900","Type":"ContainerStarted","Data":"e4b9abf96ece64e2d57d6d56626225593712555eb0a7a33996d4848d6a109701"}
Jul 08 06:56:09.185303 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.185257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:09.188563 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.188508    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:09.296920 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.296828    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:56:09.296920 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.296902    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:56:09.298428 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.298401    2575 patch_prober.go:28] interesting pod/console-74f99ccbf4-2h4mx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 08 06:56:09.298533 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.298452    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74f99ccbf4-2h4mx" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 08 06:56:09.409703 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.409667    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c4b987597-j2fr4"]
Jul 08 06:56:09.413203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.413175    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.416567 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.416546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 06:56:09.416823 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.416794    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ajtuhqbg3r7pv\""
Jul 08 06:56:09.416943 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.416836    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 06:56:09.417299 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.417279    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 06:56:09.418422 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.418402    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 06:56:09.418522 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.418431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dkj7p\""
Jul 08 06:56:09.418580 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.418435    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 06:56:09.427518 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.427497    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4b987597-j2fr4"]
Jul 08 06:56:09.447025 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.446984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:09.487390 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487390 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-grpc-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg526\" (UniqueName: \"kubernetes.io/projected/209289bf-d08c-42ff-b61c-036ed69ee52d-kube-api-access-rg526\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209289bf-d08c-42ff-b61c-036ed69ee52d-metrics-client-ca\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.487882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.487708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588720 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588720 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-grpc-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg526\" (UniqueName: \"kubernetes.io/projected/209289bf-d08c-42ff-b61c-036ed69ee52d-kube-api-access-rg526\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209289bf-d08c-42ff-b61c-036ed69ee52d-metrics-client-ca\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.588948 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.588920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.590100 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.590047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209289bf-d08c-42ff-b61c-036ed69ee52d-metrics-client-ca\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592133 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592052    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-grpc-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592390 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592460 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592644 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592588    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592644 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592626    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.592777 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.592758    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209289bf-d08c-42ff-b61c-036ed69ee52d-secret-thanos-querier-tls\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.597827 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.597808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg526\" (UniqueName: \"kubernetes.io/projected/209289bf-d08c-42ff-b61c-036ed69ee52d-kube-api-access-rg526\") pod \"thanos-querier-7c4b987597-j2fr4\" (UID: \"209289bf-d08c-42ff-b61c-036ed69ee52d\") " pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.724314 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.724276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:09.975335 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:09.975291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2" event={"ID":"0f04d47b-256f-4fc7-ac8f-d87766199cd3","Type":"ContainerStarted","Data":"c4c41c149e14e683928fbd6d0cb009ad4a4b9026dd5b5f2a01548cf9b63329cc"}
Jul 08 06:56:10.930753 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:10.930719    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8s78r"
Jul 08 06:56:11.533223 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.533191    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4b987597-j2fr4"]
Jul 08 06:56:11.536491 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:11.536459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209289bf_d08c_42ff_b61c_036ed69ee52d.slice/crio-48becf22f9f39d86176dc5b73c5cada9e90b6cf97fa12a1fc75e0a023144c9fe WatchSource:0}: Error finding container 48becf22f9f39d86176dc5b73c5cada9e90b6cf97fa12a1fc75e0a023144c9fe: Status 404 returned error can't find the container with id 48becf22f9f39d86176dc5b73c5cada9e90b6cf97fa12a1fc75e0a023144c9fe
Jul 08 06:56:11.556683 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.556557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:11.559504 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:11.559470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb157bb59_5c5e_4569_afb1_92ef6b87a678.slice/crio-56a5ea61272146a258f00728da768d2c6b37956c3647e2deb085536de3cffa8d WatchSource:0}: Error finding container 56a5ea61272146a258f00728da768d2c6b37956c3647e2deb085536de3cffa8d: Status 404 returned error can't find the container with id 56a5ea61272146a258f00728da768d2c6b37956c3647e2deb085536de3cffa8d
Jul 08 06:56:11.783852 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.783821    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58494f5f75-qzm2s"]
Jul 08 06:56:11.786083 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.786062    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.789307 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789277    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x7mwf\""
Jul 08 06:56:11.789444 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789305    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 06:56:11.789444 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789342    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 06:56:11.789444 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789365    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 06:56:11.789444 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-45l5r9gm639u1\""
Jul 08 06:56:11.789775 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.789762    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 06:56:11.797212 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.797187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58494f5f75-qzm2s"]
Jul 08 06:56:11.913214 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnnqp\" (UniqueName: \"kubernetes.io/projected/1ee408f8-14e6-4518-b6ff-127bee76cae1-kube-api-access-nnnqp\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913389 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-tls\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913389 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-metrics-server-audit-profiles\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913389 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ee408f8-14e6-4518-b6ff-127bee76cae1-audit-log\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913389 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913574 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-client-certs\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.913574 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.913485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-client-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:11.987720 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.986884    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ec80f09-27cd-423f-874d-c332e594a215" containerID="19e614085c92311cddbc473e243d42edb890a0e32ea9c30717e30484b3111561" exitCode=0
Jul 08 06:56:11.987720 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.986971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffj6m" event={"ID":"7ec80f09-27cd-423f-874d-c332e594a215","Type":"ContainerDied","Data":"19e614085c92311cddbc473e243d42edb890a0e32ea9c30717e30484b3111561"}
Jul 08 06:56:11.990892 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.990765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th" event={"ID":"4eae69ee-f49f-4777-bb18-eaf69dd89900","Type":"ContainerStarted","Data":"6de028968f7a4e0280119fe1a8f05afefb2b62e67b411b57ee66adedb2ae1f09"}
Jul 08 06:56:11.990892 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.990833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th" event={"ID":"4eae69ee-f49f-4777-bb18-eaf69dd89900","Type":"ContainerStarted","Data":"ec3047824da286d62b3bfa98653c34d93c9c07b34fcff208036497ed9b8c9295"}
Jul 08 06:56:11.993673 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.993645    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skqwb" event={"ID":"06c0c990-684b-4c63-b72c-14ca0f92f66c","Type":"ContainerStarted","Data":"5193c2c577e85cf476b77fe89bc81aa0cb91a1543e075a743dd6472b8a44bf4d"}
Jul 08 06:56:11.998565 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.998532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w7pwd" event={"ID":"50692790-2ff1-4001-81ee-bfbe0d9e5a5d","Type":"ContainerStarted","Data":"0ef63412610da0cea3252b673ae8f4c3c47fef2e1f7e6380ab80f7b3351b7aa3"}
Jul 08 06:56:11.999091 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:11.999069    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:56:12.001783 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.001758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"56a5ea61272146a258f00728da768d2c6b37956c3647e2deb085536de3cffa8d"}
Jul 08 06:56:12.003198 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.003174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"48becf22f9f39d86176dc5b73c5cada9e90b6cf97fa12a1fc75e0a023144c9fe"}
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnnqp\" (UniqueName: \"kubernetes.io/projected/1ee408f8-14e6-4518-b6ff-127bee76cae1-kube-api-access-nnnqp\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-tls\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-metrics-server-audit-profiles\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ee408f8-14e6-4518-b6ff-127bee76cae1-audit-log\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-client-certs\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.014867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-client-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.015889    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1ee408f8-14e6-4518-b6ff-127bee76cae1-audit-log\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.016029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-metrics-server-audit-profiles\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.016706 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.016662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee408f8-14e6-4518-b6ff-127bee76cae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.018968 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.018922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-tls\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.019311 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.019269    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-client-ca-bundle\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.020234 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.020208    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1ee408f8-14e6-4518-b6ff-127bee76cae1-secret-metrics-server-client-certs\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.028889 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.028859    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnnqp\" (UniqueName: \"kubernetes.io/projected/1ee408f8-14e6-4518-b6ff-127bee76cae1-kube-api-access-nnnqp\") pod \"metrics-server-58494f5f75-qzm2s\" (UID: \"1ee408f8-14e6-4518-b6ff-127bee76cae1\") " pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.040184 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.040138    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-skqwb" podStartSLOduration=66.145088876 podStartE2EDuration="1m11.040118073s" totalImagesPullingTime="4.895029197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:12.024091715 +0000 UTC m=+72.142847528" watchObservedRunningTime="2026-07-08 06:56:12.040118073 +0000 UTC m=+72.158873886"
Jul 08 06:56:12.041313 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.041107    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w7pwd" podStartSLOduration=66.144820155 podStartE2EDuration="1m11.041089127s" totalImagesPullingTime="4.896268972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:12.039769783 +0000 UTC m=+72.158525597" watchObservedRunningTime="2026-07-08 06:56:12.041089127 +0000 UTC m=+72.159844941"
Jul 08 06:56:12.100515 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.100468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:12.120573 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.119305    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"]
Jul 08 06:56:12.122055 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.122033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.125516 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.125094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 06:56:12.125516 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.125342    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t4rcv\""
Jul 08 06:56:12.132247 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.132094    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:56:12.135101 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.134734    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"]
Jul 08 06:56:12.160143 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.158593    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:12.162839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.162812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.175992 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.175955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:12.220389 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220538 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.220538 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220538 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220538 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220683 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220683 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7p99\" (UniqueName: \"kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220683 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.220816 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.220706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69wxz\" (UniqueName: \"kubernetes.io/projected/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-kube-api-access-69wxz\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:12.321282    2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:12.321352    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert podName:079eb02e-5c25-41e4-ad1d-e5ef7b5e8271 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:12.821332489 +0000 UTC m=+72.940088303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-s6ds2" (UID: "079eb02e-5c25-41e4-ad1d-e5ef7b5e8271") : secret "monitoring-plugin-cert" not found
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7p99\" (UniqueName: \"kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.321590 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.322208 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69wxz\" (UniqueName: \"kubernetes.io/projected/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-kube-api-access-69wxz\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.322208 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.321681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.323927 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.323616    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.323927 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.323621    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.324533 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.324131    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.324662 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.324650    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.327090 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.327040    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.327847 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.327807    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.339020 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.338964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69wxz\" (UniqueName: \"kubernetes.io/projected/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-kube-api-access-69wxz\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.341151 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.341128    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7p99\" (UniqueName: \"kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99\") pod \"console-58bf776b65-tnlpc\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") " pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.480926 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.480834    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:12.628123 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.627075    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b59749fc6-6r8zh"]
Jul 08 06:56:12.630232 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.630164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.637028 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637003    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 06:56:12.637412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637053    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 06:56:12.637412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637271    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5h6rv\""
Jul 08 06:56:12.637730 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637484    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 06:56:12.637730 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637541    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 06:56:12.637730 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.637559    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 06:56:12.645634 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.644708    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 06:56:12.652076 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.652049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b59749fc6-6r8zh"]
Jul 08 06:56:12.725748 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-serving-certs-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.725912 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.725912 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.725912 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mckh\" (UniqueName: \"kubernetes.io/projected/3a463b72-e502-47ad-920e-801d4a2cb2bf-kube-api-access-5mckh\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.726053 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.726053 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.726053 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.725983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-metrics-client-ca\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.726053 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.726002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-federate-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827306 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827490 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mckh\" (UniqueName: \"kubernetes.io/projected/3a463b72-e502-47ad-920e-801d4a2cb2bf-kube-api-access-5mckh\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827490 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.827490 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827490 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827791 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-metrics-client-ca\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.827865 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-federate-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.829301 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-serving-certs-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.829301 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.827944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.829301 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.828734    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-metrics-client-ca\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.829301 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.828871    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.829581 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.829316    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a463b72-e502-47ad-920e-801d4a2cb2bf-serving-certs-ca-bundle\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.830998 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.830964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/079eb02e-5c25-41e4-ad1d-e5ef7b5e8271-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-s6ds2\" (UID: \"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:12.831191 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.831140    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.831402 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.831358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-telemeter-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.831402 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.831381    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.832488 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.832449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a463b72-e502-47ad-920e-801d4a2cb2bf-federate-client-tls\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.835324 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.835303    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mckh\" (UniqueName: \"kubernetes.io/projected/3a463b72-e502-47ad-920e-801d4a2cb2bf-kube-api-access-5mckh\") pod \"telemeter-client-b59749fc6-6r8zh\" (UID: \"3a463b72-e502-47ad-920e-801d4a2cb2bf\") " pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:12.942236 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:12.942200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh"
Jul 08 06:56:13.009074 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.009036    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffj6m" event={"ID":"7ec80f09-27cd-423f-874d-c332e594a215","Type":"ContainerStarted","Data":"41bcf294fc17c7a6d22138adb857eb617261b613ff6847169a1fd2ee3f55a8d2"}
Jul 08 06:56:13.035419 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.035382    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:13.615082 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.614673    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:13.618973 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.618151    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.621966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.621799    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 06:56:13.621966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.621833    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 06:56:13.621966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.621845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4k0manh3rg2ne\""
Jul 08 06:56:13.621966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.621877    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 06:56:13.621966 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.621844    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 06:56:13.622192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.622166    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 06:56:13.622262 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.622244    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 06:56:13.622315 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.622278    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 06:56:13.622315 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.622247    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 06:56:13.623793 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.623768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tcnkh\""
Jul 08 06:56:13.624041 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.624025    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 06:56:13.624224 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.624209    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 06:56:13.624404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.624390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 06:56:13.624881 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.624851    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 06:56:13.625103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.625085    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 06:56:13.626492 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.626348    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 06:56:13.634981 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.634441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.736346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.735979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.737279 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.736011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntvsr\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.737279 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.736056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.737279 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.736086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.737279 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.736114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvsr\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.841893 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.838663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.839442    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.840347    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.840860    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.843170 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.841352    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.856279 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.856036    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.858996    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.860456    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.863634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.864055    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.864722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.866068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.866458    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.866954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.867159    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.868682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.867514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.869400 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.869023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.869458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.869394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.872248 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.869759    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntvsr\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.872248 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.870465    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.876162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.876135    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.940340 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.940234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:13.943247 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.941949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58494f5f75-qzm2s"]
Jul 08 06:56:13.993576 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.992679    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:14.001760 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:13.999839    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b59749fc6-6r8zh"]
Jul 08 06:56:14.009008 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:14.008917    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a463b72_e502_47ad_920e_801d4a2cb2bf.slice/crio-ea55cf3888a2b44c6b75da597d48a59c32ddde58dde5003295f1805b232fe3f2 WatchSource:0}: Error finding container ea55cf3888a2b44c6b75da597d48a59c32ddde58dde5003295f1805b232fe3f2: Status 404 returned error can't find the container with id ea55cf3888a2b44c6b75da597d48a59c32ddde58dde5003295f1805b232fe3f2
Jul 08 06:56:14.009807 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:56:14.009738    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb253f4ac_0561_489b_8b19_848701820922.slice/crio-bd6b84b91918fac1cd5d030d85e50562933391ce738f8d40a81b8cc5db81197c WatchSource:0}: Error finding container bd6b84b91918fac1cd5d030d85e50562933391ce738f8d40a81b8cc5db81197c: Status 404 returned error can't find the container with id bd6b84b91918fac1cd5d030d85e50562933391ce738f8d40a81b8cc5db81197c
Jul 08 06:56:14.025394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.017644    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"]
Jul 08 06:56:14.030499 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.030468    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933" exitCode=0
Jul 08 06:56:14.030712 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.030569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"}
Jul 08 06:56:14.051687 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.051429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf776b65-tnlpc" event={"ID":"b253f4ac-0561-489b-8b19-848701820922","Type":"ContainerStarted","Data":"bd6b84b91918fac1cd5d030d85e50562933391ce738f8d40a81b8cc5db81197c"}
Jul 08 06:56:14.061016 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.057079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"72d4a97fc41059d34752dea78b39eba40c8e8da3b76a71722f627078c01b53c7"}
Jul 08 06:56:14.064675 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.063941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh" event={"ID":"3a463b72-e502-47ad-920e-801d4a2cb2bf","Type":"ContainerStarted","Data":"ea55cf3888a2b44c6b75da597d48a59c32ddde58dde5003295f1805b232fe3f2"}
Jul 08 06:56:14.085622 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.085513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s" event={"ID":"1ee408f8-14e6-4518-b6ff-127bee76cae1","Type":"ContainerStarted","Data":"d5cc9eb0022e5ade5d8f05a3c1250e920c9d073e6f35a74e0716c01ee76ecb62"}
Jul 08 06:56:14.109878 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.109781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffj6m" event={"ID":"7ec80f09-27cd-423f-874d-c332e594a215","Type":"ContainerStarted","Data":"6bd30ccc61686033714c3e2e2955d5edcea75f4e30d3a307a001b289f11c6fc1"}
Jul 08 06:56:14.154469 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.152745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th" event={"ID":"4eae69ee-f49f-4777-bb18-eaf69dd89900","Type":"ContainerStarted","Data":"bea1f2c71dc1dbaff68982cbd459bd4b1decd411a5b6c443ecda47ca9f618e35"}
Jul 08 06:56:14.166246 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.166219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2" event={"ID":"0f04d47b-256f-4fc7-ac8f-d87766199cd3","Type":"ContainerStarted","Data":"d2af47b303a8e9d02cbd3df44e7d1c96041ccc1c5a02beb4fc249e6476ca5e5c"}
Jul 08 06:56:14.175735 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.175286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s69th" podStartSLOduration=5.042225638 podStartE2EDuration="7.175266675s" totalImagesPullingTime="2.133041037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:14.174123088 +0000 UTC m=+74.292878902" watchObservedRunningTime="2026-07-08 06:56:14.175266675 +0000 UTC m=+74.294022490"
Jul 08 06:56:14.175735 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.175573    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ffj6m" podStartSLOduration=3.459822797 podStartE2EDuration="7.175561573s" totalImagesPullingTime="3.618623941s" totalInitContainerRuntime="97.114835ms" isStatefulPod=true podCreationTimestamp="2026-07-08 06:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:14.134578875 +0000 UTC m=+74.253334688" watchObservedRunningTime="2026-07-08 06:56:14.175561573 +0000 UTC m=+74.294317388"
Jul 08 06:56:14.216346 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:14.216309    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:15.173758 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.173721    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2" event={"ID":"0f04d47b-256f-4fc7-ac8f-d87766199cd3","Type":"ContainerStarted","Data":"e149bad18a2f563a1a9dac825354fcd7dd00ef7f815aa25b329609e7a49e4d86"}
Jul 08 06:56:15.173758 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.173795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2" event={"ID":"0f04d47b-256f-4fc7-ac8f-d87766199cd3","Type":"ContainerStarted","Data":"f30fc816b48cde534473462ba7bb4581393eff3bd1a456261e2240bebd9ee896"}
Jul 08 06:56:15.176633 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.176587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"065766a96aeaef05c827d7a4157903c1307a6a1ac53f3a51d4e614915f34a738"}
Jul 08 06:56:15.176776 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.176672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"5ca4faa1f56b13e15c2a6ac17d73d45ef6a0e7826c89cd51df266eed22faf610"}
Jul 08 06:56:15.178799 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.178386    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5" exitCode=0
Jul 08 06:56:15.178799 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.178630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"}
Jul 08 06:56:15.178799 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.178704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"41a840b677f97ef6f2b11ff20a8bee391f309a7ebee41a7db2f6737aa4e790c6"}
Jul 08 06:56:15.181256 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.181234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf776b65-tnlpc" event={"ID":"b253f4ac-0561-489b-8b19-848701820922","Type":"ContainerStarted","Data":"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"}
Jul 08 06:56:15.182970 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.182947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2" event={"ID":"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271","Type":"ContainerStarted","Data":"378961cbff6be5fde2bc77b301b947e104877cba973cce1464a2d2a00421b1a6"}
Jul 08 06:56:15.197101 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.197016    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-spzx2" podStartSLOduration=4.40766622 podStartE2EDuration="8.197001245s" totalImagesPullingTime="3.789335025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:15.196975892 +0000 UTC m=+75.315731706" watchObservedRunningTime="2026-07-08 06:56:15.197001245 +0000 UTC m=+75.315757058"
Jul 08 06:56:15.247787 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:15.247721    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58bf776b65-tnlpc" podStartSLOduration=3.247701439 podStartE2EDuration="3.247701439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:15.247006205 +0000 UTC m=+75.365762020" watchObservedRunningTime="2026-07-08 06:56:15.247701439 +0000 UTC m=+75.366457247"
Jul 08 06:56:17.208403 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.208263    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2" event={"ID":"079eb02e-5c25-41e4-ad1d-e5ef7b5e8271","Type":"ContainerStarted","Data":"04b02485493f3ac131a433683d3b2ffac46be36030436eae3ac70794c2ada26b"}
Jul 08 06:56:17.208950 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.208640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:17.212024 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.211995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"}
Jul 08 06:56:17.214921 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.214854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh" event={"ID":"3a463b72-e502-47ad-920e-801d4a2cb2bf","Type":"ContainerStarted","Data":"4f5bf2eb912b84990b817010700fda78855a3d43fb0caaaf7f3b68f7f12227d4"}
Jul 08 06:56:17.217216 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.217159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2"
Jul 08 06:56:17.225183 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.225160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s" event={"ID":"1ee408f8-14e6-4518-b6ff-127bee76cae1","Type":"ContainerStarted","Data":"7a30aebed2de40625224cdc352d551aefc41704540f1281e79a76fcfefb9e6aa"}
Jul 08 06:56:17.237852 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.234133    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-s6ds2" podStartSLOduration=2.295265475 podStartE2EDuration="5.234113846s" totalImagesPullingTime="2.938848371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:17.227752413 +0000 UTC m=+77.346508229" watchObservedRunningTime="2026-07-08 06:56:17.234113846 +0000 UTC m=+77.352869661"
Jul 08 06:56:17.242682 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.242652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"f288c9b108bcee9b1a1e3a875d0d5f3093a530826abc18852e1520d1674a1169"}
Jul 08 06:56:17.273903 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:17.273193    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s" podStartSLOduration=3.260500938 podStartE2EDuration="6.273171478s" totalImagesPullingTime="3.01267054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:17.26925899 +0000 UTC m=+77.388014805" watchObservedRunningTime="2026-07-08 06:56:17.273171478 +0000 UTC m=+77.391927288"
Jul 08 06:56:18.251185 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.251137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"908d5c4b7641ac0440394435de9f796fa9d83b9d4eda62cc4d49127ac202a883"}
Jul 08 06:56:18.251679 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.251244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" event={"ID":"209289bf-d08c-42ff-b61c-036ed69ee52d","Type":"ContainerStarted","Data":"ae7247c8440822e916e493b823b1e8e2f5e4061d769cb7c2afedcbfaeebd58f4"}
Jul 08 06:56:18.251679 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.251295    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:18.255043 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.255016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"}
Jul 08 06:56:18.255188 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.255088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"}
Jul 08 06:56:18.255188 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.255135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"}
Jul 08 06:56:18.255302 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.255186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"}
Jul 08 06:56:18.255302 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.255220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerStarted","Data":"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"}
Jul 08 06:56:18.257648 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.257584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh" event={"ID":"3a463b72-e502-47ad-920e-801d4a2cb2bf","Type":"ContainerStarted","Data":"756394de71881cb3d6de35a18f9597a14574e8a7fa1db02d452c1f819bb2f22d"}
Jul 08 06:56:18.257770 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.257667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh" event={"ID":"3a463b72-e502-47ad-920e-801d4a2cb2bf","Type":"ContainerStarted","Data":"a6108f13eb8a4c653bdbe3124c58d093110e74db993652a39dba5354195ddbb0"}
Jul 08 06:56:18.277252 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.277189    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4" podStartSLOduration=4.367734184 podStartE2EDuration="9.277167013s" totalImagesPullingTime="4.909432829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.274004643 +0000 UTC m=+78.392760479" watchObservedRunningTime="2026-07-08 06:56:18.277167013 +0000 UTC m=+78.395922828"
Jul 08 06:56:18.297395 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.297332    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b59749fc6-6r8zh" podStartSLOduration=3.295300625 podStartE2EDuration="6.29730921s" totalImagesPullingTime="3.002008585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.294529289 +0000 UTC m=+78.413285104" watchObservedRunningTime="2026-07-08 06:56:18.29730921 +0000 UTC m=+78.416065027"
Jul 08 06:56:18.325350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.325282    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.23391881 podStartE2EDuration="10.325258194s" totalImagesPullingTime="5.053245027s" totalInitContainerRuntime="38.094357ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.323879087 +0000 UTC m=+78.442634901" watchObservedRunningTime="2026-07-08 06:56:18.325258194 +0000 UTC m=+78.444014007"
Jul 08 06:56:18.982048 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:18.982011    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:19.272464 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:19.272380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c4b987597-j2fr4"
Jul 08 06:56:20.270978 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.270942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"}
Jul 08 06:56:20.271147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.271009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"}
Jul 08 06:56:20.271147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.271039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"}
Jul 08 06:56:20.271147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.271063    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"}
Jul 08 06:56:20.271147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.271090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"}
Jul 08 06:56:20.271147 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.271112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerStarted","Data":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"}
Jul 08 06:56:20.301408 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:20.301349    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.005496462 podStartE2EDuration="7.301328992s" totalImagesPullingTime="4.27306162s" totalInitContainerRuntime="22.77091ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:20.300635081 +0000 UTC m=+80.419390895" watchObservedRunningTime="2026-07-08 06:56:20.301328992 +0000 UTC m=+80.420084805"
Jul 08 06:56:22.481518 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:22.481396    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:23.943117 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:23.943075    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:28.493744 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:28.493715    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x25g4_9ed3e11d-cdf9-40ad-9b14-dfc0143bb592/serve-healthcheck-canary/0.log"
Jul 08 06:56:32.101192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:32.101139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:32.101815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:32.101225    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:37.160150 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.160076    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74f99ccbf4-2h4mx" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" containerName="console" containerID="cri-o://742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926" gracePeriod=15
Jul 08 06:56:37.949011 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.948968    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:56:37.990821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.990784    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991008 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.990847    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991008 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.990898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991008 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.990972    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sclvd\" (UniqueName: \"kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991008 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991007    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991221 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991221 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle\") pod \"aab6ec23-6ac4-434b-964c-a83f605af754\" (UID: \"aab6ec23-6ac4-434b-964c-a83f605af754\") "
Jul 08 06:56:37.991321 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991263    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config" (OuterVolumeSpecName: "console-config") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:37.991379 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991335    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:37.991551 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991445    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:37.991675 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991558    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:37.991675 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991662    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca" (OuterVolumeSpecName: "service-ca") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:37.991780 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.991680    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:37.993305 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.993269    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:37.993423 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.993398    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:37.993423 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:37.993401    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd" (OuterVolumeSpecName: "kube-api-access-sclvd") pod "aab6ec23-6ac4-434b-964c-a83f605af754" (UID: "aab6ec23-6ac4-434b-964c-a83f605af754"). InnerVolumeSpecName "kube-api-access-sclvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:56:38.092984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.092889    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:38.092984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.092919    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:38.092984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.092928    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aab6ec23-6ac4-434b-964c-a83f605af754-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:38.092984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.092939    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aab6ec23-6ac4-434b-964c-a83f605af754-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:38.092984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.092948    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sclvd\" (UniqueName: \"kubernetes.io/projected/aab6ec23-6ac4-434b-964c-a83f605af754-kube-api-access-sclvd\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:38.349770 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.349741    2575 generic.go:356] "Generic (PLEG): container finished" podID="aab6ec23-6ac4-434b-964c-a83f605af754" containerID="742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926" exitCode=0
Jul 08 06:56:38.350238 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.349795    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f99ccbf4-2h4mx"
Jul 08 06:56:38.350238 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.349818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f99ccbf4-2h4mx" event={"ID":"aab6ec23-6ac4-434b-964c-a83f605af754","Type":"ContainerDied","Data":"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"}
Jul 08 06:56:38.350238 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.349860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f99ccbf4-2h4mx" event={"ID":"aab6ec23-6ac4-434b-964c-a83f605af754","Type":"ContainerDied","Data":"ed0c8f75deee03a55edf558828e97930c5bbe74aae6de568589b5617528edc83"}
Jul 08 06:56:38.350238 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.349882    2575 scope.go:117] "RemoveContainer" containerID="742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"
Jul 08 06:56:38.358733 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.358715    2575 scope.go:117] "RemoveContainer" containerID="742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"
Jul 08 06:56:38.359021 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:38.359002    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926\": container with ID starting with 742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926 not found: ID does not exist" containerID="742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"
Jul 08 06:56:38.359069 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.359030    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926"} err="failed to get container status \"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926\": rpc error: code = NotFound desc = could not find container \"742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926\": container with ID starting with 742f4f20fe96a9321f599b0c6e63eb4d78492fa1828fc688376617778bef4926 not found: ID does not exist"
Jul 08 06:56:38.371440 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.371413    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:56:38.377524 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.377500    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f99ccbf4-2h4mx"]
Jul 08 06:56:38.588665 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:38.588632    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" path="/var/lib/kubelet/pods/aab6ec23-6ac4-434b-964c-a83f605af754/volumes"
Jul 08 06:56:44.005339 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.005283    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58bf776b65-tnlpc" podUID="b253f4ac-0561-489b-8b19-848701820922" containerName="console" containerID="cri-o://57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116" gracePeriod=15
Jul 08 06:56:44.169248 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.169215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w7pwd"
Jul 08 06:56:44.279866 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.279796    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:44.351837 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.351803    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.351837 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.351848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.351918    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.351939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.351963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7p99\" (UniqueName: \"kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352021    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config\") pod \"b253f4ac-0561-489b-8b19-848701820922\" (UID: \"b253f4ac-0561-489b-8b19-848701820922\") "
Jul 08 06:56:44.352327 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352296    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:44.352385 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352356    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:44.352385 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352354    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config" (OuterVolumeSpecName: "console-config") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:44.352491 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.352449    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca" (OuterVolumeSpecName: "service-ca") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:44.354136 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.354105    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:44.354253 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.354178    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:44.354253 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.354196    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99" (OuterVolumeSpecName: "kube-api-access-k7p99") pod "b253f4ac-0561-489b-8b19-848701820922" (UID: "b253f4ac-0561-489b-8b19-848701820922"). InnerVolumeSpecName "kube-api-access-k7p99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:56:44.378619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.378567    2575 generic.go:356] "Generic (PLEG): container finished" podID="b253f4ac-0561-489b-8b19-848701820922" containerID="57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116" exitCode=0
Jul 08 06:56:44.378766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.378626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf776b65-tnlpc"
Jul 08 06:56:44.378766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.378635    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf776b65-tnlpc" event={"ID":"b253f4ac-0561-489b-8b19-848701820922","Type":"ContainerDied","Data":"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"}
Jul 08 06:56:44.378766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.378681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf776b65-tnlpc" event={"ID":"b253f4ac-0561-489b-8b19-848701820922","Type":"ContainerDied","Data":"bd6b84b91918fac1cd5d030d85e50562933391ce738f8d40a81b8cc5db81197c"}
Jul 08 06:56:44.378766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.378701    2575 scope.go:117] "RemoveContainer" containerID="57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"
Jul 08 06:56:44.387309 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.387287    2575 scope.go:117] "RemoveContainer" containerID="57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"
Jul 08 06:56:44.387563 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:56:44.387544    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116\": container with ID starting with 57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116 not found: ID does not exist" containerID="57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"
Jul 08 06:56:44.387636 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.387572    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116"} err="failed to get container status \"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116\": rpc error: code = NotFound desc = could not find container \"57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116\": container with ID starting with 57c0228cf86141d68d0818a73eda457e4cd3b38aca6aeb5b2d04c888ed758116 not found: ID does not exist"
Jul 08 06:56:44.400577 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.400548    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:44.404642 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.404621    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58bf776b65-tnlpc"]
Jul 08 06:56:44.453541 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453505    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453541 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453533    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453541 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453544    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7p99\" (UniqueName: \"kubernetes.io/projected/b253f4ac-0561-489b-8b19-848701820922-kube-api-access-k7p99\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453804 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453553    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453804 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453565    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b253f4ac-0561-489b-8b19-848701820922-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453804 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453577    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.453804 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.453589    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b253f4ac-0561-489b-8b19-848701820922-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:56:44.585579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:44.585504    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b253f4ac-0561-489b-8b19-848701820922" path="/var/lib/kubelet/pods/b253f4ac-0561-489b-8b19-848701820922/volumes"
Jul 08 06:56:52.106550 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:52.106518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:56:52.110458 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:56:52.110433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58494f5f75-qzm2s"
Jul 08 06:57:13.942475 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:13.942440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:13.962587 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:13.962557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:14.511143 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:14.511115    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:27.777741 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.777706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:27.778230 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778062    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="alertmanager" containerID="cri-o://d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112" gracePeriod=120
Jul 08 06:57:27.778230 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778135    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-web" containerID="cri-o://c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37" gracePeriod=120
Jul 08 06:57:27.778358 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778206    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy" containerID="cri-o://9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099" gracePeriod=120
Jul 08 06:57:27.778358 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778218    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="prom-label-proxy" containerID="cri-o://05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54" gracePeriod=120
Jul 08 06:57:27.778461 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778139    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-metric" containerID="cri-o://1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf" gracePeriod=120
Jul 08 06:57:27.778921 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:27.778741    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="config-reloader" containerID="cri-o://70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f" gracePeriod=120
Jul 08 06:57:28.550161 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550115    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54" exitCode=0
Jul 08 06:57:28.550161 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550153    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099" exitCode=0
Jul 08 06:57:28.550161 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550163    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f" exitCode=0
Jul 08 06:57:28.550392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550172    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112" exitCode=0
Jul 08 06:57:28.550392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"}
Jul 08 06:57:28.550392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"}
Jul 08 06:57:28.550392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550281    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"}
Jul 08 06:57:28.550392 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:28.550306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"}
Jul 08 06:57:29.022657 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.022591    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.135900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.135862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.135914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136098 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.135959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136235 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136119    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136235 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136160    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136235 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136195    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136235 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136227    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136320    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136358    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136385    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136697 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h799\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799\") pod \"b157bb59-5c5e-4569-afb1-92ef6b87a678\" (UID: \"b157bb59-5c5e-4569-afb1-92ef6b87a678\") "
Jul 08 06:57:29.136697 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136652    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:29.136858 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136766    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-metrics-client-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.136911 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.136853    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:29.137312 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.137283    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:29.139413 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.139359    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:29.139413 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.139363    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out" (OuterVolumeSpecName: "config-out") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:29.139847 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.139744    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume" (OuterVolumeSpecName: "config-volume") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.139847 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.139825    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799" (OuterVolumeSpecName: "kube-api-access-8h799") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "kube-api-access-8h799". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:29.139984 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.139855    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.140080 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.140057    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.140632 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.140544    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.140723 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.140697    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.144304 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.144283    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.150851 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.150832    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config" (OuterVolumeSpecName: "web-config") pod "b157bb59-5c5e-4569-afb1-92ef6b87a678" (UID: "b157bb59-5c5e-4569-afb1-92ef6b87a678"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:29.237489 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237454    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-out\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237489 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237486    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237489 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237496    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-cluster-tls-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237504    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b157bb59-5c5e-4569-afb1-92ef6b87a678-alertmanager-main-db\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237515    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237524    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237533    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237543    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-secret-alertmanager-main-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237551    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h799\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-kube-api-access-8h799\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237559    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b157bb59-5c5e-4569-afb1-92ef6b87a678-tls-assets\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237566    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-web-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.237729 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.237574    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b157bb59-5c5e-4569-afb1-92ef6b87a678-config-volume\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:29.556863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556773    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf" exitCode=0
Jul 08 06:57:29.556863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556798    2575 generic.go:356] "Generic (PLEG): container finished" podID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerID="c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37" exitCode=0
Jul 08 06:57:29.556863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"}
Jul 08 06:57:29.557111 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556865    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.557111 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"}
Jul 08 06:57:29.557111 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.556994    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b157bb59-5c5e-4569-afb1-92ef6b87a678","Type":"ContainerDied","Data":"56a5ea61272146a258f00728da768d2c6b37956c3647e2deb085536de3cffa8d"}
Jul 08 06:57:29.557111 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.557015    2575 scope.go:117] "RemoveContainer" containerID="05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"
Jul 08 06:57:29.565167 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.565101    2575 scope.go:117] "RemoveContainer" containerID="1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"
Jul 08 06:57:29.572016 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.572002    2575 scope.go:117] "RemoveContainer" containerID="9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"
Jul 08 06:57:29.579258 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.579235    2575 scope.go:117] "RemoveContainer" containerID="c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"
Jul 08 06:57:29.582182 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.582157    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:29.586656 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.586632    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:29.587558 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.587542    2575 scope.go:117] "RemoveContainer" containerID="70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"
Jul 08 06:57:29.594489 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.594463    2575 scope.go:117] "RemoveContainer" containerID="d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"
Jul 08 06:57:29.601230 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.601213    2575 scope.go:117] "RemoveContainer" containerID="c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"
Jul 08 06:57:29.607946 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.607923    2575 scope.go:117] "RemoveContainer" containerID="05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"
Jul 08 06:57:29.608205 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.608184    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54\": container with ID starting with 05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54 not found: ID does not exist" containerID="05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"
Jul 08 06:57:29.608256 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608217    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"} err="failed to get container status \"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54\": rpc error: code = NotFound desc = could not find container \"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54\": container with ID starting with 05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54 not found: ID does not exist"
Jul 08 06:57:29.608256 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608236    2575 scope.go:117] "RemoveContainer" containerID="1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"
Jul 08 06:57:29.608493 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.608474    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf\": container with ID starting with 1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf not found: ID does not exist" containerID="1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"
Jul 08 06:57:29.608537 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608499    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"} err="failed to get container status \"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf\": rpc error: code = NotFound desc = could not find container \"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf\": container with ID starting with 1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf not found: ID does not exist"
Jul 08 06:57:29.608537 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608515    2575 scope.go:117] "RemoveContainer" containerID="9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"
Jul 08 06:57:29.608759 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.608744    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099\": container with ID starting with 9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099 not found: ID does not exist" containerID="9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"
Jul 08 06:57:29.608817 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608764    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"} err="failed to get container status \"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099\": rpc error: code = NotFound desc = could not find container \"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099\": container with ID starting with 9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099 not found: ID does not exist"
Jul 08 06:57:29.608817 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608782    2575 scope.go:117] "RemoveContainer" containerID="c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"
Jul 08 06:57:29.608970 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.608957    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37\": container with ID starting with c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37 not found: ID does not exist" containerID="c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"
Jul 08 06:57:29.609010 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608972    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"} err="failed to get container status \"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37\": rpc error: code = NotFound desc = could not find container \"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37\": container with ID starting with c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37 not found: ID does not exist"
Jul 08 06:57:29.609010 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.608985    2575 scope.go:117] "RemoveContainer" containerID="70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"
Jul 08 06:57:29.609194 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.609177    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f\": container with ID starting with 70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f not found: ID does not exist" containerID="70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"
Jul 08 06:57:29.609237 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609198    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"} err="failed to get container status \"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f\": rpc error: code = NotFound desc = could not find container \"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f\": container with ID starting with 70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f not found: ID does not exist"
Jul 08 06:57:29.609237 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609213    2575 scope.go:117] "RemoveContainer" containerID="d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"
Jul 08 06:57:29.609398 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.609384    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112\": container with ID starting with d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112 not found: ID does not exist" containerID="d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"
Jul 08 06:57:29.609436 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609403    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"} err="failed to get container status \"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112\": rpc error: code = NotFound desc = could not find container \"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112\": container with ID starting with d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112 not found: ID does not exist"
Jul 08 06:57:29.609436 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609418    2575 scope.go:117] "RemoveContainer" containerID="c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"
Jul 08 06:57:29.609647 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:29.609632    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933\": container with ID starting with c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933 not found: ID does not exist" containerID="c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"
Jul 08 06:57:29.609700 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609651    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"} err="failed to get container status \"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933\": rpc error: code = NotFound desc = could not find container \"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933\": container with ID starting with c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933 not found: ID does not exist"
Jul 08 06:57:29.609700 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609663    2575 scope.go:117] "RemoveContainer" containerID="05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"
Jul 08 06:57:29.609867 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609850    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54"} err="failed to get container status \"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54\": rpc error: code = NotFound desc = could not find container \"05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54\": container with ID starting with 05f46368c5ec3a4268ebd47c501fa30a7df355a4ac80b0fb6e9d67a66b6f5a54 not found: ID does not exist"
Jul 08 06:57:29.609907 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.609867    2575 scope.go:117] "RemoveContainer" containerID="1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"
Jul 08 06:57:29.610076 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610057    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf"} err="failed to get container status \"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf\": rpc error: code = NotFound desc = could not find container \"1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf\": container with ID starting with 1e1aa023813b391214dae5730f9334a1f923abdceacfdda1773e77107f43e8cf not found: ID does not exist"
Jul 08 06:57:29.610123 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610075    2575 scope.go:117] "RemoveContainer" containerID="9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"
Jul 08 06:57:29.610253 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610237    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099"} err="failed to get container status \"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099\": rpc error: code = NotFound desc = could not find container \"9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099\": container with ID starting with 9da27f110a7b13cde844e801380802cd6e29b5480e9a68c0598ffb0ba04b2099 not found: ID does not exist"
Jul 08 06:57:29.610295 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610254    2575 scope.go:117] "RemoveContainer" containerID="c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"
Jul 08 06:57:29.610434 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610419    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37"} err="failed to get container status \"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37\": rpc error: code = NotFound desc = could not find container \"c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37\": container with ID starting with c2f6e5dd365168f9e7b09d41a44f7a2dd1f0b07862118c819cf799c057cbcd37 not found: ID does not exist"
Jul 08 06:57:29.610474 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610434    2575 scope.go:117] "RemoveContainer" containerID="70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"
Jul 08 06:57:29.610632 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610618    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f"} err="failed to get container status \"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f\": rpc error: code = NotFound desc = could not find container \"70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f\": container with ID starting with 70282012e305567afba21885e574e24f103f0bcb21e8f475272e98fd1bfd866f not found: ID does not exist"
Jul 08 06:57:29.610677 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610632    2575 scope.go:117] "RemoveContainer" containerID="d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"
Jul 08 06:57:29.610806 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610789    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112"} err="failed to get container status \"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112\": rpc error: code = NotFound desc = could not find container \"d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112\": container with ID starting with d79b6153612facc7b2826e6da678dcc873761b614200a0400f1dd240c63c6112 not found: ID does not exist"
Jul 08 06:57:29.610845 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610805    2575 scope.go:117] "RemoveContainer" containerID="c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"
Jul 08 06:57:29.610982 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.610967    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933"} err="failed to get container status \"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933\": rpc error: code = NotFound desc = could not find container \"c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933\": container with ID starting with c3022afa9cc6dff279573038cea63c87cec9540585e6d2f9f47b92f7f02cf933 not found: ID does not exist"
Jul 08 06:57:29.616089 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616069    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:29.616359 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616348    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="alertmanager"
Jul 08 06:57:29.616404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616361    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="alertmanager"
Jul 08 06:57:29.616404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616374    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy"
Jul 08 06:57:29.616404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616380    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy"
Jul 08 06:57:29.616404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616392    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b253f4ac-0561-489b-8b19-848701820922" containerName="console"
Jul 08 06:57:29.616404 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616397    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b253f4ac-0561-489b-8b19-848701820922" containerName="console"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616407    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" containerName="console"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616413    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" containerName="console"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616418    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="prom-label-proxy"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616423    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="prom-label-proxy"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616429    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="init-config-reloader"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616434    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="init-config-reloader"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616441    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="config-reloader"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616446    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="config-reloader"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616451    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616456    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616466    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-web"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616471    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-web"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616518    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616526    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab6ec23-6ac4-434b-964c-a83f605af754" containerName="console"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616533    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b253f4ac-0561-489b-8b19-848701820922" containerName="console"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616538    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616544    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="prom-label-proxy"
Jul 08 06:57:29.616545 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616550    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="alertmanager"
Jul 08 06:57:29.617140 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616556    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="config-reloader"
Jul 08 06:57:29.617140 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.616563    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" containerName="kube-rbac-proxy-web"
Jul 08 06:57:29.620743 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.620726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623763    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hdn9\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623833    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 06:57:29.623977 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623905    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 06:57:29.624343 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.623994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 06:57:29.624343 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.624236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 06:57:29.629043 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.629027    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 06:57:29.642845 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.642822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:29.741175 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741175 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvkbt\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-kube-api-access-vvkbt\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-volume\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-web-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741412 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-out\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741701 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741701 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741701 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.741701 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.741494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842656 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.842813 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvkbt\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-kube-api-access-vvkbt\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-volume\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.842947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-web-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843203 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-out\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.843802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.843779    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.844516 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.844487    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.845726 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.845700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.845823 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.845785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.845884 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.845823    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.845938 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.845911    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-out\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.846394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.846372    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.846863 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.846844    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.846947 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.846895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.847034 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.847015    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-web-config\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.847300 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.847281    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-config-volume\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.851577 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.851555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvkbt\" (UniqueName: \"kubernetes.io/projected/518d05d5-f3a0-40c9-aeef-7a8e7b89799e-kube-api-access-vvkbt\") pod \"alertmanager-main-0\" (UID: \"518d05d5-f3a0-40c9-aeef-7a8e7b89799e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:29.930131 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:29.930095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:30.066650 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:30.066619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:30.069710 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:57:30.069682    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518d05d5_f3a0_40c9_aeef_7a8e7b89799e.slice/crio-ca43aec29592c38e78f55b29a805b6bd3be729f2868a189c35efa3b4094bf780 WatchSource:0}: Error finding container ca43aec29592c38e78f55b29a805b6bd3be729f2868a189c35efa3b4094bf780: Status 404 returned error can't find the container with id ca43aec29592c38e78f55b29a805b6bd3be729f2868a189c35efa3b4094bf780
Jul 08 06:57:30.562945 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:30.562905    2575 generic.go:356] "Generic (PLEG): container finished" podID="518d05d5-f3a0-40c9-aeef-7a8e7b89799e" containerID="2f0c894972388191c69567356e64c1e8e979290d312d4d1071b01b8e64cb9360" exitCode=0
Jul 08 06:57:30.563124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:30.562945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerDied","Data":"2f0c894972388191c69567356e64c1e8e979290d312d4d1071b01b8e64cb9360"}
Jul 08 06:57:30.563124 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:30.563009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"ca43aec29592c38e78f55b29a805b6bd3be729f2868a189c35efa3b4094bf780"}
Jul 08 06:57:30.584950 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:30.584909    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b157bb59-5c5e-4569-afb1-92ef6b87a678" path="/var/lib/kubelet/pods/b157bb59-5c5e-4569-afb1-92ef6b87a678/volumes"
Jul 08 06:57:31.570416 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"af47559f8ec62a75080055dcc8734194a19adb44498790bc7590bc6d995ac116"}
Jul 08 06:57:31.570815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"dae888eae597457357ee8f8d01f2d7f8e87fff29eb196aca55652d55031e26c9"}
Jul 08 06:57:31.570815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"ed753eeeb383bb0ae4bd0c1bd596b700088daf35f400a41098b501a05b2b44d5"}
Jul 08 06:57:31.570815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"ab3f6f295565e32e09e6cbbc5677ec4a8ffe2ddd48808e32b14e3c71d739a245"}
Jul 08 06:57:31.570815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570544    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"000b97135bc9a2c650a691dfc1837f272e9c6895934971f4de64da96688b46c0"}
Jul 08 06:57:31.570815 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.570567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"518d05d5-f3a0-40c9-aeef-7a8e7b89799e","Type":"ContainerStarted","Data":"29c2658238674637350181b3448f6cff071d411094a2db7c1060a11b437ea8f3"}
Jul 08 06:57:31.599515 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:31.599463    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.584751846 podStartE2EDuration="2.59944559s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.693744ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:57:31.596369799 +0000 UTC m=+151.715125623" watchObservedRunningTime="2026-07-08 06:57:31.59944559 +0000 UTC m=+151.718201436"
Jul 08 06:57:32.050922 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.050879    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:32.051201 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051163    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="prometheus" containerID="cri-o://0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999" gracePeriod=600
Jul 08 06:57:32.051369 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051192    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy" containerID="cri-o://c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a" gracePeriod=600
Jul 08 06:57:32.051447 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051204    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="thanos-sidecar" containerID="cri-o://95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e" gracePeriod=600
Jul 08 06:57:32.051526 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051205    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-thanos" containerID="cri-o://791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2" gracePeriod=600
Jul 08 06:57:32.051589 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051210    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="config-reloader" containerID="cri-o://301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b" gracePeriod=600
Jul 08 06:57:32.051673 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.051229    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-web" containerID="cri-o://83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d" gracePeriod=600
Jul 08 06:57:32.312687 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.312659    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.367350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367314    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367389    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367441    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntvsr\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367461    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367498    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367536 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367560    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367657    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367706    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367745    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.367900 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367922    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.367988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca\") pod \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\" (UID: \"5f9af83f-282d-4eef-9f1d-e36fb0d720ae\") "
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368010    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368032    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368254    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368272    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.368344 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368288    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.368826 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.368645    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.369140 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.369014    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.369973 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.369885    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.370982 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.370239    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.370982 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.370914    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:32.371639 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.371507    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:32.371639 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.371594    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:32.373350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.372955    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.373350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.373030    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.373350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.373142    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.373350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.373146    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr" (OuterVolumeSpecName: "kube-api-access-ntvsr") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "kube-api-access-ntvsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:32.373350 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.373199    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config" (OuterVolumeSpecName: "config") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.376088 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.374852    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.376088 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.375713    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.376234 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.376196    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out" (OuterVolumeSpecName: "config-out") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:32.376326 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.376302    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.384882 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.384853    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config" (OuterVolumeSpecName: "web-config") pod "5f9af83f-282d-4eef-9f1d-e36fb0d720ae" (UID: "5f9af83f-282d-4eef-9f1d-e36fb0d720ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:32.469376 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469342    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-kube-rbac-proxy\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469376 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469369    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-metrics-client-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469376 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469382    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469392    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config-out\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469400    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-web-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469408    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntvsr\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-kube-api-access-ntvsr\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469426    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-metrics-client-certs\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469435    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469444    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469454    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469462    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469470    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-db\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469478    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469486    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469494    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-secret-grpc-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469502    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-tls-assets\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.469619 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.469509    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f9af83f-282d-4eef-9f1d-e36fb0d720ae-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578036    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2" exitCode=0
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578062    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a" exitCode=0
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578069    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d" exitCode=0
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578075    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e" exitCode=0
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578081    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b" exitCode=0
Jul 08 06:57:32.578116 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578088    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999" exitCode=0
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"}
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578405    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"}
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"}
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"}
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578588    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.578717 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"}
Jul 08 06:57:32.579037 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"}
Jul 08 06:57:32.579037 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.578869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f9af83f-282d-4eef-9f1d-e36fb0d720ae","Type":"ContainerDied","Data":"41a840b677f97ef6f2b11ff20a8bee391f309a7ebee41a7db2f6737aa4e790c6"}
Jul 08 06:57:32.593736 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.593725    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.600627 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.600594    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.607803 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.607785    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.609839 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.609815    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:32.613698 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.613677    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:32.615583 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.615569    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.622291 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.622268    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.629544 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.629529    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.636351 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.636330    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.636638 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.636618    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.636709 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.636650    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.636709 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.636677    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.636926 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.636907    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.636991 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.636933    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.636991 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.636953    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.637203 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.637187    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.637259 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637209    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.637259 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637227    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.637470 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.637451    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.637508 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637478    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.637508 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637496    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.637709 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.637693    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.637780 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637716    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.637780 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637734    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.637952 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.637935    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.637996 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637959    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.637996 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.637977    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.638203 ip-10-0-136-197 kubenswrapper[2575]: E0708 06:57:32.638189    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.638258 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638209    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.638258 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638227    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.638459 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638438    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.638495 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638460    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.638683 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638665    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.638755 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638684    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.638906 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638889    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.638951 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.638906    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.639103 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639086    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.639162 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639105    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.639329 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639312    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.639373 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639329    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.639551 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639530    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.639680 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.639553    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.640102 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640079    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.640245 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640103    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.640424 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640399    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.640500 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640437    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.640721 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640695    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.640721 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640720    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.641013 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.640994    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.641073 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641014    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.641292 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641269    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.641336 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641294    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.641558 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641538    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.641558 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641557    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.641821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641800    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.641877 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.641823    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.642057 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642037    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.642057 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642057    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.642303 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642284    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.642303 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642303    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.642414 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642356    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:32.642537 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642520    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.642626 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642549    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.642712 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642696    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy"
Jul 08 06:57:32.642748 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642716    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy"
Jul 08 06:57:32.642748 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642736    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-thanos"
Jul 08 06:57:32.642748 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642745    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-thanos"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642760    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="prometheus"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642769    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="prometheus"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642780    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="thanos-sidecar"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642786    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="thanos-sidecar"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642793    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-web"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642800    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-web"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642820    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="init-config-reloader"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642829    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="init-config-reloader"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642825    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642841    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="config-reloader"
Jul 08 06:57:32.642883 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642847    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.642850    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="config-reloader"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643006    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-web"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643026    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="config-reloader"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643039    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="thanos-sidecar"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643051    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643060    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="prometheus"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643068    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" containerName="kube-rbac-proxy-thanos"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643116    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.643437 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643134    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.643892 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643461    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.643892 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643491    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.644048 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643899    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.644048 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.643929    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.644195 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644172    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.644256 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644196    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.644452 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644433    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.644513 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644452    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.644739 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644716    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.644739 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644738    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.644975 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644942    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.644975 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.644960    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.645192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645171    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.645192 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645190    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.645427 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645410    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.645497 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645428    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.645674 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645648    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.645674 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645668    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.645906 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645887    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.645962 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.645906    2575 scope.go:117] "RemoveContainer" containerID="791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"
Jul 08 06:57:32.646129 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646103    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2"} err="failed to get container status \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": rpc error: code = NotFound desc = could not find container \"791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2\": container with ID starting with 791b5c5b030ab1cf80fb23dfcf1c1086a916250ebcb197454f1ec3ad322311c2 not found: ID does not exist"
Jul 08 06:57:32.646129 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646121    2575 scope.go:117] "RemoveContainer" containerID="c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"
Jul 08 06:57:32.646319 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646301    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a"} err="failed to get container status \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": rpc error: code = NotFound desc = could not find container \"c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a\": container with ID starting with c1d837309755ecb4f71e03af80c3dc7d99f0252961aa909fe1a4a88a4f5f0c1a not found: ID does not exist"
Jul 08 06:57:32.646358 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646321    2575 scope.go:117] "RemoveContainer" containerID="83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"
Jul 08 06:57:32.646515 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646494    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d"} err="failed to get container status \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": rpc error: code = NotFound desc = could not find container \"83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d\": container with ID starting with 83b1e59c0f54632c06d2bf29c5b7336ce3a3809007ea8a7716337f991591140d not found: ID does not exist"
Jul 08 06:57:32.646579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646515    2575 scope.go:117] "RemoveContainer" containerID="95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"
Jul 08 06:57:32.646733 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646708    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e"} err="failed to get container status \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": rpc error: code = NotFound desc = could not find container \"95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e\": container with ID starting with 95c9574fa2f46c6e4a288ce8621d93381de3252019712180425c78c764f2833e not found: ID does not exist"
Jul 08 06:57:32.646825 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.646735    2575 scope.go:117] "RemoveContainer" containerID="301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"
Jul 08 06:57:32.647033 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.647013    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b"} err="failed to get container status \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": rpc error: code = NotFound desc = could not find container \"301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b\": container with ID starting with 301838ea071fda1451810ef832dd695cd8fede9dc11cc4ac8afbdd78a3a7e20b not found: ID does not exist"
Jul 08 06:57:32.647106 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.647035    2575 scope.go:117] "RemoveContainer" containerID="0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"
Jul 08 06:57:32.648891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.647269    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999"} err="failed to get container status \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": rpc error: code = NotFound desc = could not find container \"0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999\": container with ID starting with 0ccecd1e5984fbd5fb663acfef7024d5c5b86114352792c0b8ad765e6bc64999 not found: ID does not exist"
Jul 08 06:57:32.648891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.647293    2575 scope.go:117] "RemoveContainer" containerID="9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"
Jul 08 06:57:32.648891 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.647987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.649521 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.649489    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5"} err="failed to get container status \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": rpc error: code = NotFound desc = could not find container \"9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5\": container with ID starting with 9dabd239a53b2ac169580f9586014b1bcc5810be484c93e1d632cf9d6db4ada5 not found: ID does not exist"
Jul 08 06:57:32.651330 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.651314    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tcnkh\""
Jul 08 06:57:32.651931 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.651913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 06:57:32.652008 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.651982    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 06:57:32.652064 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.651999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 06:57:32.652127 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652108    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 06:57:32.652276 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652259    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 06:57:32.652823 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652803    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 06:57:32.652933 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 06:57:32.652933 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652908    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 06:57:32.652933 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 06:57:32.653092 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.652913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 06:57:32.653151 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.653141    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4k0manh3rg2ne\""
Jul 08 06:57:32.653200 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.653168    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 06:57:32.653265 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.653205    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 06:57:32.656274 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.656252    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 06:57:32.658202 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.658106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 06:57:32.660146 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.660100    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:32.772709 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772709 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772932 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpnr\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-kube-api-access-gbpnr\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772932 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772932 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772932 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.772932 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.772966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773178 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.773384 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.773331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.873940 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.873905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.873940 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.873946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874156 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.873963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874156 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874156 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874156 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874156 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpnr\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-kube-api-access-gbpnr\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874394 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874579 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874646    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.874802 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.875100 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874833    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.875100 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.874990    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.875960 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.875935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877286 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.876978    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877286 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877286 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877056    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877286 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877221    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877575 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877355    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877575 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877548    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877753 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877691    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.877753 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.877713    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.878097 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.878072    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.878278 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.878256    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.879179 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.879152    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.879763 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.879738    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.879834 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.879745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.879834 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.879745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.880438 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.880422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.884571 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.884550    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpnr\" (UniqueName: \"kubernetes.io/projected/e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6-kube-api-access-gbpnr\") pod \"prometheus-k8s-0\" (UID: \"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:32.959334 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:32.959295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:33.096289 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:33.096257    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:57:33.099728 ip-10-0-136-197 kubenswrapper[2575]: W0708 06:57:33.099701    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cb2e58_5c1c_49df_a81b_f17d5ea3a3a6.slice/crio-06a515b9f69bb3057036817e0ee185bd51c2acad6807d88c01d05728684a65ff WatchSource:0}: Error finding container 06a515b9f69bb3057036817e0ee185bd51c2acad6807d88c01d05728684a65ff: Status 404 returned error can't find the container with id 06a515b9f69bb3057036817e0ee185bd51c2acad6807d88c01d05728684a65ff
Jul 08 06:57:33.590715 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:33.590624    2575 generic.go:356] "Generic (PLEG): container finished" podID="e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6" containerID="82fad406489bf6ff606cef1c09bf4a73caafc8e6faf6ec5de1cb17d9b0fc0c66" exitCode=0
Jul 08 06:57:33.590715 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:33.590702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerDied","Data":"82fad406489bf6ff606cef1c09bf4a73caafc8e6faf6ec5de1cb17d9b0fc0c66"}
Jul 08 06:57:33.591106 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:33.590775    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"06a515b9f69bb3057036817e0ee185bd51c2acad6807d88c01d05728684a65ff"}
Jul 08 06:57:34.585560 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.585525    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9af83f-282d-4eef-9f1d-e36fb0d720ae" path="/var/lib/kubelet/pods/5f9af83f-282d-4eef-9f1d-e36fb0d720ae/volumes"
Jul 08 06:57:34.597766 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"4f7c226b9b2d18ae2dcfae80d4f456a455cb34da59b6b988dec71b802b27ed23"}
Jul 08 06:57:34.598086 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"c922ea6bf71f651ed939d24f3f769d1eaa349c067ae5bc6eaa528716d4c01a0b"}
Jul 08 06:57:34.598086 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"f0bdd40d8395a599eb44429e3c94a6fd353cb4608359b797547254dd6225afb2"}
Jul 08 06:57:34.598086 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"ece36104e54e28ab51e9d384901f30bade32333b696cc1e203188c6c2a2e2802"}
Jul 08 06:57:34.598086 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597874    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"7b3148af6c362807933cd7b9ac66ce091dd56ca3339fdd7a56840f1a0db341f8"}
Jul 08 06:57:34.598086 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.597896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6","Type":"ContainerStarted","Data":"05eba823243a9c02894d6811b7aa76f4754971c2d021a3a13111fd91be1d9e1b"}
Jul 08 06:57:34.630821 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:34.630772    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.613126081 podStartE2EDuration="2.630755173s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.629092ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:57:34.628399905 +0000 UTC m=+154.747155721" watchObservedRunningTime="2026-07-08 06:57:34.630755173 +0000 UTC m=+154.749510986"
Jul 08 06:57:37.959818 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:57:37.959780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:32.959644 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:58:32.959582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:32.975234 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:58:32.975209    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:33.844414 ip-10-0-136-197 kubenswrapper[2575]: I0708 06:58:33.844388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 07:00:00.376490 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:00.376465    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 07:00:53.580986 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.580904    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-xvh5c"]
Jul 08 07:00:53.583116 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.583100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:53.586297 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.586274    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 08 07:00:53.586465 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.586377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-rxvk2\""
Jul 08 07:00:53.586465 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.586431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 08 07:00:53.587904 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.587887    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 08 07:00:53.596774 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.596753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-xvh5c"]
Jul 08 07:00:53.699763 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.699719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsllb\" (UniqueName: \"kubernetes.io/projected/4982a5bd-96f8-4610-87a4-722fb3e56051-kube-api-access-hsllb\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:53.699954 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.699836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:53.800705 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.800667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:53.800905 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.800719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsllb\" (UniqueName: \"kubernetes.io/projected/4982a5bd-96f8-4610-87a4-722fb3e56051-kube-api-access-hsllb\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:53.800905 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:00:53.800852    2575 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 07:00:53.801023 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:00:53.800947    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert podName:4982a5bd-96f8-4610-87a4-722fb3e56051 nodeName:}" failed. No retries permitted until 2026-07-08 07:00:54.30092331 +0000 UTC m=+354.419679129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert") pod "odh-model-controller-84b54b7f97-xvh5c" (UID: "4982a5bd-96f8-4610-87a4-722fb3e56051") : secret "odh-model-controller-webhook-cert" not found
Jul 08 07:00:53.812107 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:53.812079    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsllb\" (UniqueName: \"kubernetes.io/projected/4982a5bd-96f8-4610-87a4-722fb3e56051-kube-api-access-hsllb\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:54.305141 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:54.305101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:54.307450 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:54.307421    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4982a5bd-96f8-4610-87a4-722fb3e56051-cert\") pod \"odh-model-controller-84b54b7f97-xvh5c\" (UID: \"4982a5bd-96f8-4610-87a4-722fb3e56051\") " pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:54.493972 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:54.493935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:54.621226 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:54.621204    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-xvh5c"]
Jul 08 07:00:54.623563 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:00:54.623535    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4982a5bd_96f8_4610_87a4_722fb3e56051.slice/crio-bb1ea96234b9ac06fd3a7fe66e979b28f3a738beada504cbec70d43b7cda898c WatchSource:0}: Error finding container bb1ea96234b9ac06fd3a7fe66e979b28f3a738beada504cbec70d43b7cda898c: Status 404 returned error can't find the container with id bb1ea96234b9ac06fd3a7fe66e979b28f3a738beada504cbec70d43b7cda898c
Jul 08 07:00:54.625219 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:54.625198    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:00:55.371669 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:55.371627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-xvh5c" event={"ID":"4982a5bd-96f8-4610-87a4-722fb3e56051","Type":"ContainerStarted","Data":"bb1ea96234b9ac06fd3a7fe66e979b28f3a738beada504cbec70d43b7cda898c"}
Jul 08 07:00:58.386796 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:58.386758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-xvh5c" event={"ID":"4982a5bd-96f8-4610-87a4-722fb3e56051","Type":"ContainerStarted","Data":"4e677ec987b91810a75e9bcd21e9be071f77034a4f0fae93fdcdcb9d7cedb3d8"}
Jul 08 07:00:58.387191 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:58.386857    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:00:58.405062 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:00:58.405000    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-xvh5c" podStartSLOduration=2.032562459 podStartE2EDuration="5.404985199s" totalImagesPullingTime="3.37242274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:00:58.404462198 +0000 UTC m=+358.523218012" watchObservedRunningTime="2026-07-08 07:00:58.404985199 +0000 UTC m=+358.523741011"
Jul 08 07:01:09.393316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:09.393280    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-xvh5c"
Jul 08 07:01:10.223763 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.223730    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-9hbr6"]
Jul 08 07:01:10.229805 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.229786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.233790 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.233765    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-q9v5l\""
Jul 08 07:01:10.234014 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.233994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9hbr6"]
Jul 08 07:01:10.234093 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.233780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 08 07:01:10.356280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.356240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.356461 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.356297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgfx\" (UniqueName: \"kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.457795 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.457764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgfx\" (UniqueName: \"kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.458173 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.457832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.458173 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.458133    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.469067 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.469030    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgfx\" (UniqueName: \"kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx\") pod \"s3-init-9hbr6\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") " pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.548339 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.548248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9hbr6"
Jul 08 07:01:10.679371 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:10.679345    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9hbr6"]
Jul 08 07:01:10.681852 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:01:10.681816    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc56674d7_1338_4a0e_80ab_911abb829e71.slice/crio-2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9 WatchSource:0}: Error finding container 2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9: Status 404 returned error can't find the container with id 2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9
Jul 08 07:01:11.438035 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:11.437996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerStarted","Data":"2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9"}
Jul 08 07:01:16.461449 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:16.461392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerStarted","Data":"f1c67cdff4b0340bafd9331ac54509ca7e98cb4b1f1ea8a98e226a8846241aba"}
Jul 08 07:01:18.471402 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:18.471366    2575 generic.go:356] "Generic (PLEG): container finished" podID="c56674d7-1338-4a0e-80ab-911abb829e71" containerID="f1c67cdff4b0340bafd9331ac54509ca7e98cb4b1f1ea8a98e226a8846241aba" exitCode=0
Jul 08 07:01:18.471803 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:18.471440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerDied","Data":"f1c67cdff4b0340bafd9331ac54509ca7e98cb4b1f1ea8a98e226a8846241aba"}
Jul 08 07:01:24.501031 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:24.500999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerStarted","Data":"563d61db4bb7c3f6314600a423c85659155ba35c46392799496f176fdf388312"}
Jul 08 07:01:24.520204 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:01:24.520145    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-9hbr6" podStartSLOduration=2.6189793420000003 podStartE2EDuration="14.520127878s" totalImagesPullingTime="10.029482222s" totalInitContainerRuntime="1.871666314s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:01:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:01:24.51871778 +0000 UTC m=+384.637473608" watchObservedRunningTime="2026-07-08 07:01:24.520127878 +0000 UTC m=+384.638883690"
Jul 08 07:02:28.757504 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:28.757468    2575 generic.go:356] "Generic (PLEG): container finished" podID="c56674d7-1338-4a0e-80ab-911abb829e71" containerID="563d61db4bb7c3f6314600a423c85659155ba35c46392799496f176fdf388312" exitCode=0
Jul 08 07:02:28.757909 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:28.757510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerDied","Data":"563d61db4bb7c3f6314600a423c85659155ba35c46392799496f176fdf388312"}
Jul 08 07:02:29.888509 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:29.888481    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9hbr6"
Jul 08 07:02:30.068496 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.068406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache\") pod \"c56674d7-1338-4a0e-80ab-911abb829e71\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") "
Jul 08 07:02:30.068496 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.068446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wgfx\" (UniqueName: \"kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx\") pod \"c56674d7-1338-4a0e-80ab-911abb829e71\" (UID: \"c56674d7-1338-4a0e-80ab-911abb829e71\") "
Jul 08 07:02:30.070652 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.070613    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx" (OuterVolumeSpecName: "kube-api-access-5wgfx") pod "c56674d7-1338-4a0e-80ab-911abb829e71" (UID: "c56674d7-1338-4a0e-80ab-911abb829e71"). InnerVolumeSpecName "kube-api-access-5wgfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:02:30.087505 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.087466    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache" (OuterVolumeSpecName: "model-cache") pod "c56674d7-1338-4a0e-80ab-911abb829e71" (UID: "c56674d7-1338-4a0e-80ab-911abb829e71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:30.169246 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.169214    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56674d7-1338-4a0e-80ab-911abb829e71-model-cache\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:30.169246 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.169245    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wgfx\" (UniqueName: \"kubernetes.io/projected/c56674d7-1338-4a0e-80ab-911abb829e71-kube-api-access-5wgfx\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:30.771650 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.771592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9hbr6" event={"ID":"c56674d7-1338-4a0e-80ab-911abb829e71","Type":"ContainerDied","Data":"2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9"}
Jul 08 07:02:30.771809 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.771659    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ae82b116292c3f6bd4632613b5f5821981751962e794d6a89f1b84c3c936ed9"
Jul 08 07:02:30.771809 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:30.771635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9hbr6"
Jul 08 07:02:31.490315 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490279    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:31.490821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490649    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56674d7-1338-4a0e-80ab-911abb829e71" containerName="download-hf-model"
Jul 08 07:02:31.490821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490661    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56674d7-1338-4a0e-80ab-911abb829e71" containerName="download-hf-model"
Jul 08 07:02:31.490821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490669    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56674d7-1338-4a0e-80ab-911abb829e71" containerName="s3-init"
Jul 08 07:02:31.490821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490674    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56674d7-1338-4a0e-80ab-911abb829e71" containerName="s3-init"
Jul 08 07:02:31.490821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.490737    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56674d7-1338-4a0e-80ab-911abb829e71" containerName="s3-init"
Jul 08 07:02:31.493008 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.492993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.495764 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.495741    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 08 07:02:31.495888 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.495754    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-q9v5l\""
Jul 08 07:02:31.502226 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.502201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:31.580618 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.580566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.580779 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.580653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8qn\" (UniqueName: \"kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.681521 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.681483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8qn\" (UniqueName: \"kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.681747 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.681544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.681977 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.681948    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.690217 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.690192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8qn\" (UniqueName: \"kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn\") pod \"seaweedfs-tls-custom-6644bf5d6c-tp2n9\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.803085 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.802999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:31.931956 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:31.931933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:31.934069 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:02:31.934045    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46289dc6_3072_409f_b825_d1bc5ac2162f.slice/crio-c43407a153c9ed1376a9781c1bdd2ad77694ffcb3cd6b4645defe1d045889a3a WatchSource:0}: Error finding container c43407a153c9ed1376a9781c1bdd2ad77694ffcb3cd6b4645defe1d045889a3a: Status 404 returned error can't find the container with id c43407a153c9ed1376a9781c1bdd2ad77694ffcb3cd6b4645defe1d045889a3a
Jul 08 07:02:32.782896 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:32.782853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" event={"ID":"46289dc6-3072-409f-b825-d1bc5ac2162f","Type":"ContainerStarted","Data":"c43407a153c9ed1376a9781c1bdd2ad77694ffcb3cd6b4645defe1d045889a3a"}
Jul 08 07:02:35.799490 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:35.799454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" event={"ID":"46289dc6-3072-409f-b825-d1bc5ac2162f","Type":"ContainerStarted","Data":"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"}
Jul 08 07:02:35.814874 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:35.814824    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" podStartSLOduration=1.518740339 podStartE2EDuration="4.81480929s" totalImagesPullingTime="3.296068951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:02:35.813581331 +0000 UTC m=+455.932337146" watchObservedRunningTime="2026-07-08 07:02:35.81480929 +0000 UTC m=+455.933565102"
Jul 08 07:02:36.844205 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:36.844164    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:37.807270 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:37.807230    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" podUID="46289dc6-3072-409f-b825-d1bc5ac2162f" containerName="seaweedfs-tls-custom" containerID="cri-o://cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e" gracePeriod=30
Jul 08 07:02:39.051766 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.051743    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:39.148231 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.148200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data\") pod \"46289dc6-3072-409f-b825-d1bc5ac2162f\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") "
Jul 08 07:02:39.149412 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.149388    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data" (OuterVolumeSpecName: "data") pod "46289dc6-3072-409f-b825-d1bc5ac2162f" (UID: "46289dc6-3072-409f-b825-d1bc5ac2162f"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:39.249361 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.249323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8qn\" (UniqueName: \"kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn\") pod \"46289dc6-3072-409f-b825-d1bc5ac2162f\" (UID: \"46289dc6-3072-409f-b825-d1bc5ac2162f\") "
Jul 08 07:02:39.249548 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.249532    2575 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46289dc6-3072-409f-b825-d1bc5ac2162f-data\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:39.251366 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.251331    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn" (OuterVolumeSpecName: "kube-api-access-cg8qn") pod "46289dc6-3072-409f-b825-d1bc5ac2162f" (UID: "46289dc6-3072-409f-b825-d1bc5ac2162f"). InnerVolumeSpecName "kube-api-access-cg8qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:02:39.349970 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.349933    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8qn\" (UniqueName: \"kubernetes.io/projected/46289dc6-3072-409f-b825-d1bc5ac2162f-kube-api-access-cg8qn\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:39.817952 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.817922    2575 generic.go:356] "Generic (PLEG): container finished" podID="46289dc6-3072-409f-b825-d1bc5ac2162f" containerID="cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e" exitCode=0
Jul 08 07:02:39.818122 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.817965    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"
Jul 08 07:02:39.818122 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.817983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" event={"ID":"46289dc6-3072-409f-b825-d1bc5ac2162f","Type":"ContainerDied","Data":"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"}
Jul 08 07:02:39.818122 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.818020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9" event={"ID":"46289dc6-3072-409f-b825-d1bc5ac2162f","Type":"ContainerDied","Data":"c43407a153c9ed1376a9781c1bdd2ad77694ffcb3cd6b4645defe1d045889a3a"}
Jul 08 07:02:39.818122 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.818040    2575 scope.go:117] "RemoveContainer" containerID="cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"
Jul 08 07:02:39.828148 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.828130    2575 scope.go:117] "RemoveContainer" containerID="cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"
Jul 08 07:02:39.828473 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:02:39.828444    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e\": container with ID starting with cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e not found: ID does not exist" containerID="cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"
Jul 08 07:02:39.828527 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.828482    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e"} err="failed to get container status \"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e\": rpc error: code = NotFound desc = could not find container \"cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e\": container with ID starting with cd64188c39fcebb93195b55c09bbfba24a6fa8a2b48a00280612a1b1655d3a7e not found: ID does not exist"
Jul 08 07:02:39.844147 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.844111    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:39.846492 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.846462    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-tp2n9"]
Jul 08 07:02:39.868613 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.868567    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-76flw"]
Jul 08 07:02:39.868950 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.868936    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46289dc6-3072-409f-b825-d1bc5ac2162f" containerName="seaweedfs-tls-custom"
Jul 08 07:02:39.868995 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.868952    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="46289dc6-3072-409f-b825-d1bc5ac2162f" containerName="seaweedfs-tls-custom"
Jul 08 07:02:39.869028 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.869010    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="46289dc6-3072-409f-b825-d1bc5ac2162f" containerName="seaweedfs-tls-custom"
Jul 08 07:02:39.872851 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.872836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:39.875799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.875780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\""
Jul 08 07:02:39.875914 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.875796    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 08 07:02:39.875914 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.875806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-q9v5l\""
Jul 08 07:02:39.880099 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.880078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-76flw"]
Jul 08 07:02:39.954499 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.954460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:39.954499 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.954502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d8b19d4-50e7-41d4-8df5-cefb4b357007-data\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:39.954760 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:39.954522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs2r9\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-kube-api-access-xs2r9\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.055545 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.055510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.055545 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.055550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d8b19d4-50e7-41d4-8df5-cefb4b357007-data\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.056081 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.055569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs2r9\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-kube-api-access-xs2r9\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.056081 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.055908    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d8b19d4-50e7-41d4-8df5-cefb4b357007-data\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.058171 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.058149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.064720 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.064695    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs2r9\" (UniqueName: \"kubernetes.io/projected/9d8b19d4-50e7-41d4-8df5-cefb4b357007-kube-api-access-xs2r9\") pod \"seaweedfs-tls-custom-8b44d767d-76flw\" (UID: \"9d8b19d4-50e7-41d4-8df5-cefb4b357007\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.182636 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.182567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw"
Jul 08 07:02:40.314558 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.314534    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-76flw"]
Jul 08 07:02:40.316687 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:02:40.316660    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8b19d4_50e7_41d4_8df5_cefb4b357007.slice/crio-76e92b11db12669217e8e06c9ec5951e044c77a5099d002d00b407d41d64d916 WatchSource:0}: Error finding container 76e92b11db12669217e8e06c9ec5951e044c77a5099d002d00b407d41d64d916: Status 404 returned error can't find the container with id 76e92b11db12669217e8e06c9ec5951e044c77a5099d002d00b407d41d64d916
Jul 08 07:02:40.585278 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.585198    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46289dc6-3072-409f-b825-d1bc5ac2162f" path="/var/lib/kubelet/pods/46289dc6-3072-409f-b825-d1bc5ac2162f/volumes"
Jul 08 07:02:40.823239 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.823202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw" event={"ID":"9d8b19d4-50e7-41d4-8df5-cefb4b357007","Type":"ContainerStarted","Data":"a1bb601180284c1cffb0f2c004254d6fb4027684e94da1ab60d909a62ff6e352"}
Jul 08 07:02:40.823427 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.823258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw" event={"ID":"9d8b19d4-50e7-41d4-8df5-cefb4b357007","Type":"ContainerStarted","Data":"76e92b11db12669217e8e06c9ec5951e044c77a5099d002d00b407d41d64d916"}
Jul 08 07:02:40.840667 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:40.840555    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-76flw" podStartSLOduration=1.542122598 podStartE2EDuration="1.840538693s" totalImagesPullingTime="298.416095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:02:40.839443017 +0000 UTC m=+460.958198847" watchObservedRunningTime="2026-07-08 07:02:40.840538693 +0000 UTC m=+460.959294506"
Jul 08 07:02:41.129751 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.129715    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-fbcnp"]
Jul 08 07:02:41.132523 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.132506    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.141747 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.141716    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-fbcnp"]
Jul 08 07:02:41.163538 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.163509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nl2n\" (UniqueName: \"kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.163736 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.163588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.264667 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.264629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.264835 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.264721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nl2n\" (UniqueName: \"kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.264975 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.264956    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.273288 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.273261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nl2n\" (UniqueName: \"kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n\") pod \"s3-tls-init-custom-fbcnp\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") " pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.454269 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.454169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:41.583203 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.583180    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-fbcnp"]
Jul 08 07:02:41.585130 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:02:41.585103    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd563e03a_6012_4443_8d19_e0adbaf708c9.slice/crio-10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77 WatchSource:0}: Error finding container 10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77: Status 404 returned error can't find the container with id 10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77
Jul 08 07:02:41.830096 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.830006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerStarted","Data":"e08fcbbb5291d4026e63f87d56ed2439dad7bea867f20f5cf54d22576694d440"}
Jul 08 07:02:41.830096 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:41.830056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerStarted","Data":"10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77"}
Jul 08 07:02:43.840770 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:43.840739    2575 generic.go:356] "Generic (PLEG): container finished" podID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerID="e08fcbbb5291d4026e63f87d56ed2439dad7bea867f20f5cf54d22576694d440" exitCode=0
Jul 08 07:02:43.841166 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:43.840819    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerDied","Data":"e08fcbbb5291d4026e63f87d56ed2439dad7bea867f20f5cf54d22576694d440"}
Jul 08 07:02:44.846850 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:44.846817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerStarted","Data":"1d5d238937e26fd0f630094d9401af343a9e7525351236aeaa2d9f64ab7886fe"}
Jul 08 07:02:44.866709 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:44.866662    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-fbcnp" podStartSLOduration=2.283884592 podStartE2EDuration="3.866646374s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.582761782s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:02:44.86553238 +0000 UTC m=+464.984288194" watchObservedRunningTime="2026-07-08 07:02:44.866646374 +0000 UTC m=+464.985402186"
Jul 08 07:02:50.874462 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:50.874430    2575 generic.go:356] "Generic (PLEG): container finished" podID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerID="1d5d238937e26fd0f630094d9401af343a9e7525351236aeaa2d9f64ab7886fe" exitCode=0
Jul 08 07:02:50.874857 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:50.874502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerDied","Data":"1d5d238937e26fd0f630094d9401af343a9e7525351236aeaa2d9f64ab7886fe"}
Jul 08 07:02:52.046780 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.046753    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:52.167024 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.166933    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nl2n\" (UniqueName: \"kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n\") pod \"d563e03a-6012-4443-8d19-e0adbaf708c9\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") "
Jul 08 07:02:52.167024 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.167028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache\") pod \"d563e03a-6012-4443-8d19-e0adbaf708c9\" (UID: \"d563e03a-6012-4443-8d19-e0adbaf708c9\") "
Jul 08 07:02:52.168932 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.168904    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n" (OuterVolumeSpecName: "kube-api-access-7nl2n") pod "d563e03a-6012-4443-8d19-e0adbaf708c9" (UID: "d563e03a-6012-4443-8d19-e0adbaf708c9"). InnerVolumeSpecName "kube-api-access-7nl2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:02:52.189186 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.189154    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "d563e03a-6012-4443-8d19-e0adbaf708c9" (UID: "d563e03a-6012-4443-8d19-e0adbaf708c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:52.268202 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.268173    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d563e03a-6012-4443-8d19-e0adbaf708c9-model-cache\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:52.268202 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.268200    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nl2n\" (UniqueName: \"kubernetes.io/projected/d563e03a-6012-4443-8d19-e0adbaf708c9-kube-api-access-7nl2n\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:02:52.883394 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.883365    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fbcnp"
Jul 08 07:02:52.883552 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.883393    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fbcnp" event={"ID":"d563e03a-6012-4443-8d19-e0adbaf708c9","Type":"ContainerDied","Data":"10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77"}
Jul 08 07:02:52.883552 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:52.883425    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10a8b8bc8d0a8009f9c048af3076cd78ec0d4194ed7426f5f510868300889a77"
Jul 08 07:02:55.719500 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719467    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-qcxxc"]
Jul 08 07:02:55.719875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719833    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerName="download-hf-model"
Jul 08 07:02:55.719875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719846    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerName="download-hf-model"
Jul 08 07:02:55.719875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719854    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerName="s3-tls-init-custom"
Jul 08 07:02:55.719875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719859    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerName="s3-tls-init-custom"
Jul 08 07:02:55.720004 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.719918    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d563e03a-6012-4443-8d19-e0adbaf708c9" containerName="s3-tls-init-custom"
Jul 08 07:02:55.722864 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.722849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.725477 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.725456    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Jul 08 07:02:55.736809 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.736787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qcxxc"]
Jul 08 07:02:55.796472 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.796430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7zmx\" (UniqueName: \"kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.796643 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.796496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.897717 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.897686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.897883 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.897743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7zmx\" (UniqueName: \"kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.898085 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.898065    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:55.906067 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:55.906043    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7zmx\" (UniqueName: \"kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx\") pod \"s3-tls-init-serving-qcxxc\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") " pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:56.043314 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:56.043226    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:02:56.172682 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:56.172630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qcxxc"]
Jul 08 07:02:56.176117 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:02:56.176081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ffe8425_e24a_42a7_bd02_911e87a0a325.slice/crio-b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c WatchSource:0}: Error finding container b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c: Status 404 returned error can't find the container with id b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c
Jul 08 07:02:56.902141 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:56.902104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerStarted","Data":"a739ae8d37759b19eee159ad721dff509a9847f133c68dd940d846da51842a6e"}
Jul 08 07:02:56.902141 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:56.902148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerStarted","Data":"b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c"}
Jul 08 07:02:57.909048 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:57.909010    2575 generic.go:356] "Generic (PLEG): container finished" podID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerID="a739ae8d37759b19eee159ad721dff509a9847f133c68dd940d846da51842a6e" exitCode=0
Jul 08 07:02:57.909446 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:57.909096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerDied","Data":"a739ae8d37759b19eee159ad721dff509a9847f133c68dd940d846da51842a6e"}
Jul 08 07:02:58.915134 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:58.915096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerStarted","Data":"f9ffa5f6cdcf3c8bbdf0868a01f9b69b1859742eea55ff95ece59f1475707023"}
Jul 08 07:02:58.932546 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:02:58.932496    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-qcxxc" podStartSLOduration=2.309623869 podStartE2EDuration="3.932481454s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.622857585s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:02:58.93122892 +0000 UTC m=+479.049984733" watchObservedRunningTime="2026-07-08 07:02:58.932481454 +0000 UTC m=+479.051237267"
Jul 08 07:03:04.944250 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:04.944216    2575 generic.go:356] "Generic (PLEG): container finished" podID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerID="f9ffa5f6cdcf3c8bbdf0868a01f9b69b1859742eea55ff95ece59f1475707023" exitCode=0
Jul 08 07:03:04.944679 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:04.944285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerDied","Data":"f9ffa5f6cdcf3c8bbdf0868a01f9b69b1859742eea55ff95ece59f1475707023"}
Jul 08 07:03:06.088663 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.088641    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:03:06.197533 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.197482    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache\") pod \"6ffe8425-e24a-42a7-bd02-911e87a0a325\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") "
Jul 08 07:03:06.197739 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.197591    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7zmx\" (UniqueName: \"kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx\") pod \"6ffe8425-e24a-42a7-bd02-911e87a0a325\" (UID: \"6ffe8425-e24a-42a7-bd02-911e87a0a325\") "
Jul 08 07:03:06.199621 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.199568    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx" (OuterVolumeSpecName: "kube-api-access-t7zmx") pod "6ffe8425-e24a-42a7-bd02-911e87a0a325" (UID: "6ffe8425-e24a-42a7-bd02-911e87a0a325"). InnerVolumeSpecName "kube-api-access-t7zmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:06.224284 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.224247    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ffe8425-e24a-42a7-bd02-911e87a0a325" (UID: "6ffe8425-e24a-42a7-bd02-911e87a0a325"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:06.298813 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.298769    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7zmx\" (UniqueName: \"kubernetes.io/projected/6ffe8425-e24a-42a7-bd02-911e87a0a325-kube-api-access-t7zmx\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:03:06.298813 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.298809    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffe8425-e24a-42a7-bd02-911e87a0a325-model-cache\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:03:06.954192 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.954157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcxxc" event={"ID":"6ffe8425-e24a-42a7-bd02-911e87a0a325","Type":"ContainerDied","Data":"b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c"}
Jul 08 07:03:06.954192 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.954184    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcxxc"
Jul 08 07:03:06.954192 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:06.954197    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b452f6e6582727821d631e31e7561f7f1bf9046bd453b834ecbb84178688606c"
Jul 08 07:03:18.568305 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:03:18.568789 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568774    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerName="download-hf-model"
Jul 08 07:03:18.568846 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568792    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerName="download-hf-model"
Jul 08 07:03:18.568846 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerName="s3-tls-init-serving"
Jul 08 07:03:18.568846 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568835    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerName="s3-tls-init-serving"
Jul 08 07:03:18.568949 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.568906    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ffe8425-e24a-42a7-bd02-911e87a0a325" containerName="s3-tls-init-serving"
Jul 08 07:03:18.572359 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.572342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.575238 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575216    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-predictor-serving-cert\""
Jul 08 07:03:18.575403 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575371    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:03:18.575499 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575413    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:03:18.575499 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-kube-rbac-proxy-sar-config\""
Jul 08 07:03:18.575765 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575751    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:03:18.575811 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.575789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:03:18.576218 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.576201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:03:18.585978 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.585954    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:03:18.706373 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.706335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.706550 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.706412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.706643 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.706572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqn5d\" (UniqueName: \"kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.706714 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.706655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.706714 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.706681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807455 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.807412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqn5d\" (UniqueName: \"kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.807482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.807508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.807549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:03:18.807578    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-serving-cert: secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.807624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.807681 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:03:18.807664    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls podName:b9ce780f-db83-4bf5-8d33-a679bfab47fa nodeName:}" failed. No retries permitted until 2026-07-08 07:03:19.30764747 +0000 UTC m=+499.426403260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls") pod "isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa") : secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 08 07:03:18.808085 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.808065    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.808226 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.808208    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.808294 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.808278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:18.816640 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:18.816591    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqn5d\" (UniqueName: \"kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:19.312946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:19.312896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:19.315353 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:19.315328    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:19.482857 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:19.482817    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:19.621319 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:19.621295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:03:19.623255 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:03:19.623231    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ce780f_db83_4bf5_8d33_a679bfab47fa.slice/crio-2112c62d25ea2b6f35d0a954bfe724a6c504022a2f6dd286d5b42e5927b0224f WatchSource:0}: Error finding container 2112c62d25ea2b6f35d0a954bfe724a6c504022a2f6dd286d5b42e5927b0224f: Status 404 returned error can't find the container with id 2112c62d25ea2b6f35d0a954bfe724a6c504022a2f6dd286d5b42e5927b0224f
Jul 08 07:03:20.008010 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:20.007971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerStarted","Data":"66e598ee8f09ee3f8ea7466f235d786182336eccf298bcc87bb3ad8cfc5907bb"}
Jul 08 07:03:20.008210 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:20.008045    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerStarted","Data":"2112c62d25ea2b6f35d0a954bfe724a6c504022a2f6dd286d5b42e5927b0224f"}
Jul 08 07:03:24.026115 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:24.026073    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerID="66e598ee8f09ee3f8ea7466f235d786182336eccf298bcc87bb3ad8cfc5907bb" exitCode=0
Jul 08 07:03:24.026486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:24.026156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerDied","Data":"66e598ee8f09ee3f8ea7466f235d786182336eccf298bcc87bb3ad8cfc5907bb"}
Jul 08 07:03:39.120481 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:39.120446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerStarted","Data":"986784656d596dbd2748eacb88276d472ae3331e6e53515bc97d73460e8ee08c"}
Jul 08 07:03:42.140590 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:42.140552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerStarted","Data":"fa74f9d801fcefcb42b9c0a03cfdb24c4283e753388e87af7ec7b8fef0d44e23"}
Jul 08 07:03:45.157278 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:45.157244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerStarted","Data":"7fc84ac6f9395c63e012d903bd36b191f894b94d22f46fea6bc0ab22e0ae8613"}
Jul 08 07:03:45.157723 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:45.157423    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:45.181680 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:45.181632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podStartSLOduration=3.261101756 podStartE2EDuration="27.181618558s" totalImagesPullingTime="20.328178511s" totalInitContainerRuntime="3.592338291s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:03:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:03:45.179461468 +0000 UTC m=+525.298217305" watchObservedRunningTime="2026-07-08 07:03:45.181618558 +0000 UTC m=+525.300374370"
Jul 08 07:03:46.162078 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:46.162042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:46.162487 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:46.162109    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:46.163435 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:46.163395    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:03:46.164171 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:46.164139    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:03:46.167018 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:46.167000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:03:47.166545 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:47.166503    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:03:47.166983 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:47.166792    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:03:48.170564 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:48.170526    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:03:48.170964 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:48.170873    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:03:58.170707 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:58.170591    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:03:58.171057 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:03:58.170975    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:08.171359 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:08.171308    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:04:08.171806 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:08.171721    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:18.170504 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:18.170449    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:04:18.171041 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:18.170963    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:28.171046 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:28.170995    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:04:28.171450 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:28.171410    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:38.170752 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:38.170694    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:04:38.171220 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:38.171128    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:48.171365 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:48.171320    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:04:48.171860 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:48.171700    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:04:58.171421 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:58.171389    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:04:58.171944 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:04:58.171528    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:13.657994 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.657963    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:05:13.658379 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.658220    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" containerID="cri-o://986784656d596dbd2748eacb88276d472ae3331e6e53515bc97d73460e8ee08c" gracePeriod=30
Jul 08 07:05:13.658379 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.658230    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" containerID="cri-o://7fc84ac6f9395c63e012d903bd36b191f894b94d22f46fea6bc0ab22e0ae8613" gracePeriod=30
Jul 08 07:05:13.658379 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.658291    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" containerID="cri-o://fa74f9d801fcefcb42b9c0a03cfdb24c4283e753388e87af7ec7b8fef0d44e23" gracePeriod=30
Jul 08 07:05:13.679219 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.679195    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:05:13.682087 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.682068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.684950 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.684931    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-kube-rbac-proxy-sar-config\""
Jul 08 07:05:13.685258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.685242    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-predictor-serving-cert\""
Jul 08 07:05:13.694992 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.694972    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:05:13.760368 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.760331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhjp\" (UniqueName: \"kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.760536 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.760383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.760536 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.760436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.760536 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.760525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.760684 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.760555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.861639 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.861594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.861828 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.861651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.861828 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.861690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.861828 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.861721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.861828 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.861794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhjp\" (UniqueName: \"kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.862160 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.862139    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.862495 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.862473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.862628 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.862519    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.863983 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.863963    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.870796 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.870773    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhjp\" (UniqueName: \"kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:13.991985 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:13.991900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:14.124222 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:14.124198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:05:14.125841 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:05:14.125820    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230facd0_3d70_47b1_a809_cfa702db1ff0.slice/crio-7319c63beae3ffdf833f2ca43c92827260719045c78f475cc31a42b515b81548 WatchSource:0}: Error finding container 7319c63beae3ffdf833f2ca43c92827260719045c78f475cc31a42b515b81548: Status 404 returned error can't find the container with id 7319c63beae3ffdf833f2ca43c92827260719045c78f475cc31a42b515b81548
Jul 08 07:05:14.544651 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:14.544587    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerID="fa74f9d801fcefcb42b9c0a03cfdb24c4283e753388e87af7ec7b8fef0d44e23" exitCode=2
Jul 08 07:05:14.544828 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:14.544662    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerDied","Data":"fa74f9d801fcefcb42b9c0a03cfdb24c4283e753388e87af7ec7b8fef0d44e23"}
Jul 08 07:05:14.546212 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:14.546191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerStarted","Data":"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"}
Jul 08 07:05:14.546356 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:14.546244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerStarted","Data":"7319c63beae3ffdf833f2ca43c92827260719045c78f475cc31a42b515b81548"}
Jul 08 07:05:16.163306 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:16.163264    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:18.171210 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.171124    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:18.171684 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.171393    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:18.566793 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.566717    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerID="986784656d596dbd2748eacb88276d472ae3331e6e53515bc97d73460e8ee08c" exitCode=0
Jul 08 07:05:18.566940 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.566792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerDied","Data":"986784656d596dbd2748eacb88276d472ae3331e6e53515bc97d73460e8ee08c"}
Jul 08 07:05:18.568205 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.568182    2575 generic.go:356] "Generic (PLEG): container finished" podID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerID="1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13" exitCode=0
Jul 08 07:05:18.568299 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:18.568254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerDied","Data":"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"}
Jul 08 07:05:19.575405 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerStarted","Data":"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"}
Jul 08 07:05:19.575840 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerStarted","Data":"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"}
Jul 08 07:05:19.575840 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575464    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerStarted","Data":"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"}
Jul 08 07:05:19.575840 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575803    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:19.575993 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:19.575993 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.575908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:19.577298 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.577269    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:19.577952 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.577928    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:19.599096 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:19.599050    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podStartSLOduration=2.868690184 podStartE2EDuration="6.599038211s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.730348027s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:19.596455591 +0000 UTC m=+619.715211433" watchObservedRunningTime="2026-07-08 07:05:19.599038211 +0000 UTC m=+619.717794023"
Jul 08 07:05:20.582723 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:20.582681    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:20.583208 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:20.583180    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:21.162241 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:21.162199    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:25.587008 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:25.586979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:05:25.587566 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:25.587532    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:25.587788 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:25.587765    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:26.162644 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:26.162579    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:26.162834 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:26.162767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:28.170497 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:28.170448    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:28.170903 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:28.170811    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:31.162979 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:31.162935    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:35.587784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:35.587740    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:35.588187 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:35.588110    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:36.162404 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:36.162363    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:38.170551 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:38.170501    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:38.170990 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:38.170703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:38.170990 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:38.170779    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:38.170990 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:38.170855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:41.162355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:41.162311    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:05:43.685328 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.685294    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerID="7fc84ac6f9395c63e012d903bd36b191f894b94d22f46fea6bc0ab22e0ae8613" exitCode=0
Jul 08 07:05:43.685688 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.685339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerDied","Data":"7fc84ac6f9395c63e012d903bd36b191f894b94d22f46fea6bc0ab22e0ae8613"}
Jul 08 07:05:43.808795 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.808772    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:43.929987 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.929914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqn5d\" (UniqueName: \"kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d\") pod \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") "
Jul 08 07:05:43.929987 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.929951    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location\") pod \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") "
Jul 08 07:05:43.930177 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930006    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") pod \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") "
Jul 08 07:05:43.930177 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930057    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert\") pod \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") "
Jul 08 07:05:43.930177 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config\") pod \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\" (UID: \"b9ce780f-db83-4bf5-8d33-a679bfab47fa\") "
Jul 08 07:05:43.930316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930262    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b9ce780f-db83-4bf5-8d33-a679bfab47fa" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:05:43.930443 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930422    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:05:43.930443 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930419    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b9ce780f-db83-4bf5-8d33-a679bfab47fa" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:05:43.930579 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.930499    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b9ce780f-db83-4bf5-8d33-a679bfab47fa" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:05:43.932677 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.932655    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d" (OuterVolumeSpecName: "kube-api-access-qqn5d") pod "b9ce780f-db83-4bf5-8d33-a679bfab47fa" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa"). InnerVolumeSpecName "kube-api-access-qqn5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:05:43.932677 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:43.932670    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b9ce780f-db83-4bf5-8d33-a679bfab47fa" (UID: "b9ce780f-db83-4bf5-8d33-a679bfab47fa"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:05:44.031799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.031764    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:05:44.031799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.031789    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqn5d\" (UniqueName: \"kubernetes.io/projected/b9ce780f-db83-4bf5-8d33-a679bfab47fa-kube-api-access-qqn5d\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:05:44.031799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.031799    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ce780f-db83-4bf5-8d33-a679bfab47fa-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:05:44.031799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.031807    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ce780f-db83-4bf5-8d33-a679bfab47fa-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:05:44.691581 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.691548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj" event={"ID":"b9ce780f-db83-4bf5-8d33-a679bfab47fa","Type":"ContainerDied","Data":"2112c62d25ea2b6f35d0a954bfe724a6c504022a2f6dd286d5b42e5927b0224f"}
Jul 08 07:05:44.692045 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.691638    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"
Jul 08 07:05:44.692045 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.691650    2575 scope.go:117] "RemoveContainer" containerID="7fc84ac6f9395c63e012d903bd36b191f894b94d22f46fea6bc0ab22e0ae8613"
Jul 08 07:05:44.699784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.699767    2575 scope.go:117] "RemoveContainer" containerID="fa74f9d801fcefcb42b9c0a03cfdb24c4283e753388e87af7ec7b8fef0d44e23"
Jul 08 07:05:44.707075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.707056    2575 scope.go:117] "RemoveContainer" containerID="986784656d596dbd2748eacb88276d472ae3331e6e53515bc97d73460e8ee08c"
Jul 08 07:05:44.711911 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.711891    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:05:44.714434 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.714413    2575 scope.go:117] "RemoveContainer" containerID="66e598ee8f09ee3f8ea7466f235d786182336eccf298bcc87bb3ad8cfc5907bb"
Jul 08 07:05:44.718119 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:44.718097    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-dktsj"]
Jul 08 07:05:45.588053 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:45.588017    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:45.588486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:45.588461    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:05:46.585519 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:46.585489    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" path="/var/lib/kubelet/pods/b9ce780f-db83-4bf5-8d33-a679bfab47fa/volumes"
Jul 08 07:05:55.587430 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:55.587391    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:05:55.589136 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:05:55.587819    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:06:05.588002 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:05.587965    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:06:05.588531 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:05.588452    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:06:15.588394 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:15.588353    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:06:15.588865 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:15.588841    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:06:25.587578 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:25.587532    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:06:25.587984 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:25.587954    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:06:35.588659 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:35.588632    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:06:35.589061 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:35.588812    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:06:48.852789 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.852756    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:06:48.853368 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.853265    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" containerID="cri-o://4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf" gracePeriod=30
Jul 08 07:06:48.853368 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.853323    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" containerID="cri-o://a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d" gracePeriod=30
Jul 08 07:06:48.853467 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.853281    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" containerID="cri-o://0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f" gracePeriod=30
Jul 08 07:06:48.862640 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862619    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:06:48.862958 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862947    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="storage-initializer"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862960    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="storage-initializer"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862971    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862983    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.862989    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.863007    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy"
Jul 08 07:06:48.863016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.863012    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy"
Jul 08 07:06:48.863216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.863067    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kserve-container"
Jul 08 07:06:48.863216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.863076    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="kube-rbac-proxy"
Jul 08 07:06:48.863216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.863086    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ce780f-db83-4bf5-8d33-a679bfab47fa" containerName="agent"
Jul 08 07:06:48.865418 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.865399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:48.868227 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.868207    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\""
Jul 08 07:06:48.868315 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.868264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\""
Jul 08 07:06:48.875504 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.875481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:06:48.973471 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.973434    2575 generic.go:356] "Generic (PLEG): container finished" podID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerID="a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d" exitCode=2
Jul 08 07:06:48.973616 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:48.973503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerDied","Data":"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"}
Jul 08 07:06:49.013060 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.013035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.013194 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.013067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.013194 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.013088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85z9\" (UniqueName: \"kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.114658 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.114556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.114658 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.114594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.114658 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.114635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85z9\" (UniqueName: \"kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.115360 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.115339    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.117093 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.117074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.122339 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.122309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85z9\" (UniqueName: \"kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9\") pod \"message-dumper-predictor-6575bcfdfd-jc4s9\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.175312 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.175278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:49.302415 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.302394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:06:49.304592 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:06:49.304563    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcef51a_7637_4c81_8c8f_d49e49f80626.slice/crio-a94e735ab64176aac350427706dc14011eef16ce730de8aaa4a1352abc7a6d43 WatchSource:0}: Error finding container a94e735ab64176aac350427706dc14011eef16ce730de8aaa4a1352abc7a6d43: Status 404 returned error can't find the container with id a94e735ab64176aac350427706dc14011eef16ce730de8aaa4a1352abc7a6d43
Jul 08 07:06:49.306595 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.306581    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:06:49.978789 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:49.978756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerStarted","Data":"a94e735ab64176aac350427706dc14011eef16ce730de8aaa4a1352abc7a6d43"}
Jul 08 07:06:50.583777 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:50.583739    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:06:50.984572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:50.984538    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerStarted","Data":"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"}
Jul 08 07:06:50.985081 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:50.984613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerStarted","Data":"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"}
Jul 08 07:06:50.985081 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:50.984651    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:51.005562 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:51.005511    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" podStartSLOduration=1.7172000779999999 podStartE2EDuration="3.005496407s" totalImagesPullingTime="1.288296329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:06:51.002975731 +0000 UTC m=+711.121731550" watchObservedRunningTime="2026-07-08 07:06:51.005496407 +0000 UTC m=+711.124252219"
Jul 08 07:06:51.988822 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:51.988787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:51.990488 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:51.990469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:06:53.999762 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:53.999733    2575 generic.go:356] "Generic (PLEG): container finished" podID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerID="4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf" exitCode=0
Jul 08 07:06:54.000179 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:53.999810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerDied","Data":"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"}
Jul 08 07:06:55.583247 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:55.583212    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:06:55.587538 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:55.587511    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:06:55.587888 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:55.587862    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:06:59.004958 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:06:59.004929    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:07:00.582830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:00.582791    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:07:00.585042 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:00.585014    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:07:05.583746 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:05.583711    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:07:05.588062 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:05.588030    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:07:05.588387 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:05.588366    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:08.917874 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.917844    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:07:08.923569 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.923550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:08.926520 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.926499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-predictor-serving-cert\""
Jul 08 07:07:08.926520 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.926511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-kube-rbac-proxy-sar-config\""
Jul 08 07:07:08.934474 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.934450    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:07:08.988892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.988865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:08.989079 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.988931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:08.989079 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.989017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxx67\" (UniqueName: \"kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:08.989079 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.989057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:08.989250 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:08.989086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090279 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090434 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090434 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxx67\" (UniqueName: \"kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090434 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090434 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.090859 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.090834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.091108 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.091088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.091151 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.091088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.092844 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.092825    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.099004 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.098979    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxx67\" (UniqueName: \"kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67\") pod \"isvc-logger-predictor-7997fc58c6-w9s8f\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.233974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.233878    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:09.367191 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:09.367165    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:07:09.368776 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:07:09.368752    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f2684f_0224_47cd_9065_f78f946e8f4b.slice/crio-266dd788659245512fa459a967721970643614fabe349a714d594534b414a359 WatchSource:0}: Error finding container 266dd788659245512fa459a967721970643614fabe349a714d594534b414a359: Status 404 returned error can't find the container with id 266dd788659245512fa459a967721970643614fabe349a714d594534b414a359
Jul 08 07:07:10.076213 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:10.076173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerStarted","Data":"bd02ddcfcacc46fe3e0282a797bc96a98499ecb93794b5ed6c48e7b6cc63eec0"}
Jul 08 07:07:10.076580 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:10.076241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerStarted","Data":"266dd788659245512fa459a967721970643614fabe349a714d594534b414a359"}
Jul 08 07:07:10.582839 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:10.582797    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:07:14.094256 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:14.094211    2575 generic.go:356] "Generic (PLEG): container finished" podID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerID="bd02ddcfcacc46fe3e0282a797bc96a98499ecb93794b5ed6c48e7b6cc63eec0" exitCode=0
Jul 08 07:07:14.094652 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:14.094291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerDied","Data":"bd02ddcfcacc46fe3e0282a797bc96a98499ecb93794b5ed6c48e7b6cc63eec0"}
Jul 08 07:07:15.100984 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.100951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerStarted","Data":"2e6b83de50f9ce20de57ce77de4e3a4b917ab6cbf7dec5eae5df23843f2c7ed6"}
Jul 08 07:07:15.101475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.101024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerStarted","Data":"10fa593d4861ccb8ae963b2efbef53ccbd99b9061c47caa5dee888af4dd6cf5d"}
Jul 08 07:07:15.101475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.101072    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerStarted","Data":"01d749dc6a7ab30716d48b5f33ce79547a67ea37b1d81cf5778f5198edb55f6d"}
Jul 08 07:07:15.101475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.101376    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:15.101475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.101443    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:15.101475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.101473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:15.102627 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.102580    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:15.103313 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.103291    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:15.125108 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.125059    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podStartSLOduration=3.348510375 podStartE2EDuration="7.125045472s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.776535097s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:07:15.122909262 +0000 UTC m=+735.241665114" watchObservedRunningTime="2026-07-08 07:07:15.125045472 +0000 UTC m=+735.243801282"
Jul 08 07:07:15.583831 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.583741    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:07:15.588024 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.587995    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 08 07:07:15.588163 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.588125    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:07:15.588328 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.588307    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:15.588418 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:15.588405    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:07:16.105537 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:16.105492    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:16.105960 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:16.105886    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:18.999928 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:18.999905    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:07:19.075696 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.075656    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config\") pod \"230facd0-3d70-47b1-a809-cfa702db1ff0\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") "
Jul 08 07:07:19.075879 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.075734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert\") pod \"230facd0-3d70-47b1-a809-cfa702db1ff0\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") "
Jul 08 07:07:19.075879 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.075757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location\") pod \"230facd0-3d70-47b1-a809-cfa702db1ff0\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") "
Jul 08 07:07:19.075879 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.075787    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls\") pod \"230facd0-3d70-47b1-a809-cfa702db1ff0\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") "
Jul 08 07:07:19.075879 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.075812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nhjp\" (UniqueName: \"kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp\") pod \"230facd0-3d70-47b1-a809-cfa702db1ff0\" (UID: \"230facd0-3d70-47b1-a809-cfa702db1ff0\") "
Jul 08 07:07:19.076106 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.076073    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "230facd0-3d70-47b1-a809-cfa702db1ff0" (UID: "230facd0-3d70-47b1-a809-cfa702db1ff0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:19.076157 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.076113    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "230facd0-3d70-47b1-a809-cfa702db1ff0" (UID: "230facd0-3d70-47b1-a809-cfa702db1ff0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:07:19.076157 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.076137    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "230facd0-3d70-47b1-a809-cfa702db1ff0" (UID: "230facd0-3d70-47b1-a809-cfa702db1ff0"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:19.077998 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.077972    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "230facd0-3d70-47b1-a809-cfa702db1ff0" (UID: "230facd0-3d70-47b1-a809-cfa702db1ff0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:07:19.077998 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.077988    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp" (OuterVolumeSpecName: "kube-api-access-7nhjp") pod "230facd0-3d70-47b1-a809-cfa702db1ff0" (UID: "230facd0-3d70-47b1-a809-cfa702db1ff0"). InnerVolumeSpecName "kube-api-access-7nhjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:07:19.121392 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.121321    2575 generic.go:356] "Generic (PLEG): container finished" podID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerID="0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f" exitCode=0
Jul 08 07:07:19.121392 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.121382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"
Jul 08 07:07:19.121392 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.121386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerDied","Data":"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"}
Jul 08 07:07:19.121576 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.121439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v" event={"ID":"230facd0-3d70-47b1-a809-cfa702db1ff0","Type":"ContainerDied","Data":"7319c63beae3ffdf833f2ca43c92827260719045c78f475cc31a42b515b81548"}
Jul 08 07:07:19.121576 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.121468    2575 scope.go:117] "RemoveContainer" containerID="0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"
Jul 08 07:07:19.129705 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.129688    2575 scope.go:117] "RemoveContainer" containerID="a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"
Jul 08 07:07:19.137255 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.137239    2575 scope.go:117] "RemoveContainer" containerID="4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"
Jul 08 07:07:19.145532 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.145489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:07:19.145698 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.145674    2575 scope.go:117] "RemoveContainer" containerID="1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"
Jul 08 07:07:19.147475 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.147458    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-z8f2v"]
Jul 08 07:07:19.153392 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.153364    2575 scope.go:117] "RemoveContainer" containerID="0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"
Jul 08 07:07:19.153653 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:07:19.153626    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f\": container with ID starting with 0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f not found: ID does not exist" containerID="0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"
Jul 08 07:07:19.153747 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.153667    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f"} err="failed to get container status \"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f\": rpc error: code = NotFound desc = could not find container \"0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f\": container with ID starting with 0b52f739827f428b36e70369e17dffce50db59739784566623f0769ef4dd101f not found: ID does not exist"
Jul 08 07:07:19.153747 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.153691    2575 scope.go:117] "RemoveContainer" containerID="a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"
Jul 08 07:07:19.153957 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:07:19.153940    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d\": container with ID starting with a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d not found: ID does not exist" containerID="a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"
Jul 08 07:07:19.154008 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.153963    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d"} err="failed to get container status \"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d\": rpc error: code = NotFound desc = could not find container \"a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d\": container with ID starting with a57bf81baf691bb6f51ce5a52a96cf477a5d43ac6c58651ebef85f140e2a978d not found: ID does not exist"
Jul 08 07:07:19.154008 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.153979    2575 scope.go:117] "RemoveContainer" containerID="4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"
Jul 08 07:07:19.154251 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:07:19.154233    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf\": container with ID starting with 4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf not found: ID does not exist" containerID="4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"
Jul 08 07:07:19.154291 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.154253    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf"} err="failed to get container status \"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf\": rpc error: code = NotFound desc = could not find container \"4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf\": container with ID starting with 4b392c81c29bbf8090e446e934b8740f25309b9ca477f90b850af924c53d69cf not found: ID does not exist"
Jul 08 07:07:19.154291 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.154265    2575 scope.go:117] "RemoveContainer" containerID="1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"
Jul 08 07:07:19.154486 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:07:19.154468    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13\": container with ID starting with 1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13 not found: ID does not exist" containerID="1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"
Jul 08 07:07:19.154528 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.154492    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13"} err="failed to get container status \"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13\": rpc error: code = NotFound desc = could not find container \"1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13\": container with ID starting with 1a00b6fb822fbd6607efb87093958a4f8387dadd01322cac5233a287337f2f13 not found: ID does not exist"
Jul 08 07:07:19.176974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.176952    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:07:19.176974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.176974    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/230facd0-3d70-47b1-a809-cfa702db1ff0-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:07:19.177095 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.176983    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/230facd0-3d70-47b1-a809-cfa702db1ff0-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:07:19.177095 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.176992    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/230facd0-3d70-47b1-a809-cfa702db1ff0-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:07:19.177095 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:19.177000    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nhjp\" (UniqueName: \"kubernetes.io/projected/230facd0-3d70-47b1-a809-cfa702db1ff0-kube-api-access-7nhjp\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:07:20.585051 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:20.585012    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" path="/var/lib/kubelet/pods/230facd0-3d70-47b1-a809-cfa702db1ff0/volumes"
Jul 08 07:07:21.110709 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:21.110680    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:07:21.116868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:21.116825    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:21.117283 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:21.117258    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:31.112281 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:31.112235    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:31.112807 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:31.112723    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:41.112548 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:41.112502    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:41.112972 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:41.112925    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:07:51.111946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:51.111902    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:51.112342 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:07:51.112063    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:01.112009 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:01.111970    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:01.112390 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:01.112251    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:11.112042 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:11.111997    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:11.112474 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:11.112115    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:21.111935 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:21.111890    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:21.112361 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:21.112332    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:26.590222 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:26.590196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:08:26.590614 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:26.590283    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:08:33.911781 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:33.911749    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-jc4s9_fdcef51a-7637-4c81-8c8f-d49e49f80626/kserve-container/0.log"
Jul 08 07:08:34.078820 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.078790    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:08:34.079084 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.079044    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" containerID="cri-o://01d749dc6a7ab30716d48b5f33ce79547a67ea37b1d81cf5778f5198edb55f6d" gracePeriod=30
Jul 08 07:08:34.079176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.079089    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" containerID="cri-o://2e6b83de50f9ce20de57ce77de4e3a4b917ab6cbf7dec5eae5df23843f2c7ed6" gracePeriod=30
Jul 08 07:08:34.079321 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.079293    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" containerID="cri-o://10fa593d4861ccb8ae963b2efbef53ccbd99b9061c47caa5dee888af4dd6cf5d" gracePeriod=30
Jul 08 07:08:34.133768 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.133740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:08:34.134130 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134117    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="storage-initializer"
Jul 08 07:08:34.134172 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134132    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="storage-initializer"
Jul 08 07:08:34.134172 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134143    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy"
Jul 08 07:08:34.134172 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134149    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy"
Jul 08 07:08:34.134172 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134158    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent"
Jul 08 07:08:34.134172 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134164    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent"
Jul 08 07:08:34.134323 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134190    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container"
Jul 08 07:08:34.134323 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134196    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container"
Jul 08 07:08:34.134323 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134249    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kserve-container"
Jul 08 07:08:34.134323 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134262    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="agent"
Jul 08 07:08:34.134323 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.134272    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="230facd0-3d70-47b1-a809-cfa702db1ff0" containerName="kube-rbac-proxy"
Jul 08 07:08:34.137554 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.137537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.140289 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.140269    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-predictor-serving-cert\""
Jul 08 07:08:34.140389 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.140295    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-kube-rbac-proxy-sar-config\""
Jul 08 07:08:34.148035 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.147970    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:08:34.203491 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.203462    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:08:34.203708 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.203688    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kserve-container" containerID="cri-o://d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7" gracePeriod=30
Jul 08 07:08:34.203770 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.203723    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kube-rbac-proxy" containerID="cri-o://c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355" gracePeriod=30
Jul 08 07:08:34.242249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.242226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.242356 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.242257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.242356 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.242322    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.242431 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.242358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.242431 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.242407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtkk\" (UniqueName: \"kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.343765 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.343736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtkk\" (UniqueName: \"kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.343946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.343801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.343946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.343822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.343946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.343857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.343946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.343881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.344165 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:08:34.343970    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-v1-predictor-serving-cert: secret "isvc-autogluon-v1-predictor-serving-cert" not found
Jul 08 07:08:34.344165 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:08:34.344045    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls podName:7651462c-af82-45db-af92-41ff0e7959ab nodeName:}" failed. No retries permitted until 2026-07-08 07:08:34.844023922 +0000 UTC m=+814.962779733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls") pod "isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" (UID: "7651462c-af82-45db-af92-41ff0e7959ab") : secret "isvc-autogluon-v1-predictor-serving-cert" not found
Jul 08 07:08:34.344320 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.344297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.344693 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.344674    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.344741 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.344674    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.353078 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.353051    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtkk\" (UniqueName: \"kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.447588 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.447530    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:08:34.462134 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.462111    2575 generic.go:356] "Generic (PLEG): container finished" podID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerID="10fa593d4861ccb8ae963b2efbef53ccbd99b9061c47caa5dee888af4dd6cf5d" exitCode=2
Jul 08 07:08:34.462271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.462190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerDied","Data":"10fa593d4861ccb8ae963b2efbef53ccbd99b9061c47caa5dee888af4dd6cf5d"}
Jul 08 07:08:34.463641 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463591    2575 generic.go:356] "Generic (PLEG): container finished" podID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerID="c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355" exitCode=2
Jul 08 07:08:34.463743 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463645    2575 generic.go:356] "Generic (PLEG): container finished" podID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerID="d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7" exitCode=2
Jul 08 07:08:34.463743 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463658    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"
Jul 08 07:08:34.463743 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerDied","Data":"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"}
Jul 08 07:08:34.463906 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerDied","Data":"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"}
Jul 08 07:08:34.463906 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9" event={"ID":"fdcef51a-7637-4c81-8c8f-d49e49f80626","Type":"ContainerDied","Data":"a94e735ab64176aac350427706dc14011eef16ce730de8aaa4a1352abc7a6d43"}
Jul 08 07:08:34.463906 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.463807    2575 scope.go:117] "RemoveContainer" containerID="c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"
Jul 08 07:08:34.472989 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.472974    2575 scope.go:117] "RemoveContainer" containerID="d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"
Jul 08 07:08:34.482747 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.481010    2575 scope.go:117] "RemoveContainer" containerID="c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"
Jul 08 07:08:34.483270 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:08:34.483244    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355\": container with ID starting with c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355 not found: ID does not exist" containerID="c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"
Jul 08 07:08:34.483350 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.483282    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"} err="failed to get container status \"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355\": rpc error: code = NotFound desc = could not find container \"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355\": container with ID starting with c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355 not found: ID does not exist"
Jul 08 07:08:34.483350 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.483306    2575 scope.go:117] "RemoveContainer" containerID="d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"
Jul 08 07:08:34.483713 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:08:34.483690    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7\": container with ID starting with d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7 not found: ID does not exist" containerID="d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"
Jul 08 07:08:34.483829 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.483720    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"} err="failed to get container status \"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7\": rpc error: code = NotFound desc = could not find container \"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7\": container with ID starting with d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7 not found: ID does not exist"
Jul 08 07:08:34.483829 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.483744    2575 scope.go:117] "RemoveContainer" containerID="c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"
Jul 08 07:08:34.484002 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.483984    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355"} err="failed to get container status \"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355\": rpc error: code = NotFound desc = could not find container \"c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355\": container with ID starting with c251100a43f9bbb1891f71b716ff24452e6fd00f9d6f90eaa525f79694b80355 not found: ID does not exist"
Jul 08 07:08:34.484075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.484005    2575 scope.go:117] "RemoveContainer" containerID="d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"
Jul 08 07:08:34.484297 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.484269    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7"} err="failed to get container status \"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7\": rpc error: code = NotFound desc = could not find container \"d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7\": container with ID starting with d83d1148f247d4007244267be80e4a382cbaf8083e763de0d926dc461306aab7 not found: ID does not exist"
Jul 08 07:08:34.545190 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.545166    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls\") pod \"fdcef51a-7637-4c81-8c8f-d49e49f80626\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") "
Jul 08 07:08:34.545328 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.545196    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n85z9\" (UniqueName: \"kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9\") pod \"fdcef51a-7637-4c81-8c8f-d49e49f80626\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") "
Jul 08 07:08:34.545328 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.545221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config\") pod \"fdcef51a-7637-4c81-8c8f-d49e49f80626\" (UID: \"fdcef51a-7637-4c81-8c8f-d49e49f80626\") "
Jul 08 07:08:34.545615 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.545577    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fdcef51a-7637-4c81-8c8f-d49e49f80626" (UID: "fdcef51a-7637-4c81-8c8f-d49e49f80626"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:08:34.547280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.547259    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fdcef51a-7637-4c81-8c8f-d49e49f80626" (UID: "fdcef51a-7637-4c81-8c8f-d49e49f80626"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:08:34.547280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.547270    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9" (OuterVolumeSpecName: "kube-api-access-n85z9") pod "fdcef51a-7637-4c81-8c8f-d49e49f80626" (UID: "fdcef51a-7637-4c81-8c8f-d49e49f80626"). InnerVolumeSpecName "kube-api-access-n85z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:08:34.646806 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.646775    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcef51a-7637-4c81-8c8f-d49e49f80626-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:08:34.646806 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.646799    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n85z9\" (UniqueName: \"kubernetes.io/projected/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-api-access-n85z9\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:08:34.646806 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.646809    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdcef51a-7637-4c81-8c8f-d49e49f80626-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:08:34.780843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.780735    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:08:34.782730 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.782710    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-jc4s9"]
Jul 08 07:08:34.848675 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.848644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:34.850946 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:34.850922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:35.048694 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:35.048588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:08:35.178072 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:35.178048    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:08:35.179678 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:08:35.179654    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7651462c_af82_45db_af92_41ff0e7959ab.slice/crio-c0edf0bbb5eb5885f68943fa5f8443995eeb8a4e26aad65319ec45da60f7371b WatchSource:0}: Error finding container c0edf0bbb5eb5885f68943fa5f8443995eeb8a4e26aad65319ec45da60f7371b: Status 404 returned error can't find the container with id c0edf0bbb5eb5885f68943fa5f8443995eeb8a4e26aad65319ec45da60f7371b
Jul 08 07:08:35.469039 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:35.468998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerStarted","Data":"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"}
Jul 08 07:08:35.469238 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:35.469064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerStarted","Data":"c0edf0bbb5eb5885f68943fa5f8443995eeb8a4e26aad65319ec45da60f7371b"}
Jul 08 07:08:36.106136 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:36.106097    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:08:36.581731 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:36.581633    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:36.581993 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:36.581963    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:36.586163 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:36.586137    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" path="/var/lib/kubelet/pods/fdcef51a-7637-4c81-8c8f-d49e49f80626/volumes"
Jul 08 07:08:39.490274 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:39.490241    2575 generic.go:356] "Generic (PLEG): container finished" podID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerID="01d749dc6a7ab30716d48b5f33ce79547a67ea37b1d81cf5778f5198edb55f6d" exitCode=0
Jul 08 07:08:39.490730 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:39.490315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerDied","Data":"01d749dc6a7ab30716d48b5f33ce79547a67ea37b1d81cf5778f5198edb55f6d"}
Jul 08 07:08:41.105854 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:41.105812    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:08:46.105845 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:46.105802    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:08:46.106224 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:46.105927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:08:46.581582 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:46.581492    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:46.581915 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:46.581886    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:51.105918 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:51.105873    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:08:56.106478 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:56.106433    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:08:56.581379 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:56.581283    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:56.581660 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:56.581636    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:08:56.585124 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:56.585104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:08:56.585234 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:08:56.585180    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:09:01.106091 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:01.106053    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 08 07:09:04.595963 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.595858    2575 generic.go:356] "Generic (PLEG): container finished" podID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerID="2e6b83de50f9ce20de57ce77de4e3a4b917ab6cbf7dec5eae5df23843f2c7ed6" exitCode=0
Jul 08 07:09:04.595963 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.595938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerDied","Data":"2e6b83de50f9ce20de57ce77de4e3a4b917ab6cbf7dec5eae5df23843f2c7ed6"}
Jul 08 07:09:04.727849 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.727824    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:09:04.917626 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.917582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls\") pod \"83f2684f-0224-47cd-9065-f78f946e8f4b\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") "
Jul 08 07:09:04.917843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.917705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config\") pod \"83f2684f-0224-47cd-9065-f78f946e8f4b\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") "
Jul 08 07:09:04.917843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.917743    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location\") pod \"83f2684f-0224-47cd-9065-f78f946e8f4b\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") "
Jul 08 07:09:04.917843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.917790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxx67\" (UniqueName: \"kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67\") pod \"83f2684f-0224-47cd-9065-f78f946e8f4b\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") "
Jul 08 07:09:04.917843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.917816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert\") pod \"83f2684f-0224-47cd-9065-f78f946e8f4b\" (UID: \"83f2684f-0224-47cd-9065-f78f946e8f4b\") "
Jul 08 07:09:04.918082 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.918059    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "83f2684f-0224-47cd-9065-f78f946e8f4b" (UID: "83f2684f-0224-47cd-9065-f78f946e8f4b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:04.918192 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.918167    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "83f2684f-0224-47cd-9065-f78f946e8f4b" (UID: "83f2684f-0224-47cd-9065-f78f946e8f4b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:09:04.918281 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.918260    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "83f2684f-0224-47cd-9065-f78f946e8f4b" (UID: "83f2684f-0224-47cd-9065-f78f946e8f4b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:09:04.920065 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.920040    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67" (OuterVolumeSpecName: "kube-api-access-zxx67") pod "83f2684f-0224-47cd-9065-f78f946e8f4b" (UID: "83f2684f-0224-47cd-9065-f78f946e8f4b"). InnerVolumeSpecName "kube-api-access-zxx67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:09:04.920203 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:04.920177    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "83f2684f-0224-47cd-9065-f78f946e8f4b" (UID: "83f2684f-0224-47cd-9065-f78f946e8f4b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:09:05.019249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.019212    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83f2684f-0224-47cd-9065-f78f946e8f4b-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:09:05.019249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.019241    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:09:05.019249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.019252    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83f2684f-0224-47cd-9065-f78f946e8f4b-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:09:05.019249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.019261    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxx67\" (UniqueName: \"kubernetes.io/projected/83f2684f-0224-47cd-9065-f78f946e8f4b-kube-api-access-zxx67\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:09:05.019520 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.019269    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83f2684f-0224-47cd-9065-f78f946e8f4b-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:09:05.602974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.602951    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"
Jul 08 07:09:05.602974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.602951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f" event={"ID":"83f2684f-0224-47cd-9065-f78f946e8f4b","Type":"ContainerDied","Data":"266dd788659245512fa459a967721970643614fabe349a714d594534b414a359"}
Jul 08 07:09:05.603481 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.603048    2575 scope.go:117] "RemoveContainer" containerID="2e6b83de50f9ce20de57ce77de4e3a4b917ab6cbf7dec5eae5df23843f2c7ed6"
Jul 08 07:09:05.604486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.604466    2575 generic.go:356] "Generic (PLEG): container finished" podID="7651462c-af82-45db-af92-41ff0e7959ab" containerID="756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f" exitCode=0
Jul 08 07:09:05.604578 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.604510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerDied","Data":"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"}
Jul 08 07:09:05.611827 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.611810    2575 scope.go:117] "RemoveContainer" containerID="10fa593d4861ccb8ae963b2efbef53ccbd99b9061c47caa5dee888af4dd6cf5d"
Jul 08 07:09:05.619624 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.619591    2575 scope.go:117] "RemoveContainer" containerID="01d749dc6a7ab30716d48b5f33ce79547a67ea37b1d81cf5778f5198edb55f6d"
Jul 08 07:09:05.627831 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.627814    2575 scope.go:117] "RemoveContainer" containerID="bd02ddcfcacc46fe3e0282a797bc96a98499ecb93794b5ed6c48e7b6cc63eec0"
Jul 08 07:09:05.642798 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.642773    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:09:05.646147 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:05.646120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-w9s8f"]
Jul 08 07:09:06.591580 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:09:06.591544    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" path="/var/lib/kubelet/pods/83f2684f-0224-47cd-9065-f78f946e8f4b/volumes"
Jul 08 07:11:22.260036 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:22.259945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerStarted","Data":"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"}
Jul 08 07:11:22.260036 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:22.260003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerStarted","Data":"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"}
Jul 08 07:11:22.260569 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:22.260150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:22.289546 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:22.289495    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podStartSLOduration=1.9362887899999999 podStartE2EDuration="2m48.289480302s" totalImagesPullingTime="2m16.290638024s" totalInitContainerRuntime="30.062553488s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:11:22.286797301 +0000 UTC m=+982.405553139" watchObservedRunningTime="2026-07-08 07:11:22.289480302 +0000 UTC m=+982.408236203"
Jul 08 07:11:23.265614 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:23.265583    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:23.266676 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:23.266652    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:11:24.269857 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:24.269819    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:11:29.274619 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:29.274580    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:29.275300 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:29.275271    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:11:39.276328 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:39.276298    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:44.344311 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:44.344275    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:11:44.344735 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:44.344526    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container" containerID="cri-o://46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2" gracePeriod=30
Jul 08 07:11:44.344735 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:44.344570    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kube-rbac-proxy" containerID="cri-o://18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639" gracePeriod=30
Jul 08 07:11:45.226724 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.226692    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:45.324109 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert\") pod \"7651462c-af82-45db-af92-41ff0e7959ab\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") "
Jul 08 07:11:45.324109 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324088    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") pod \"7651462c-af82-45db-af92-41ff0e7959ab\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") "
Jul 08 07:11:45.324286 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location\") pod \"7651462c-af82-45db-af92-41ff0e7959ab\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") "
Jul 08 07:11:45.324286 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config\") pod \"7651462c-af82-45db-af92-41ff0e7959ab\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") "
Jul 08 07:11:45.324286 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrtkk\" (UniqueName: \"kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk\") pod \"7651462c-af82-45db-af92-41ff0e7959ab\" (UID: \"7651462c-af82-45db-af92-41ff0e7959ab\") "
Jul 08 07:11:45.324463 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324443    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7651462c-af82-45db-af92-41ff0e7959ab" (UID: "7651462c-af82-45db-af92-41ff0e7959ab"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:11:45.324503 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.324483    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7651462c-af82-45db-af92-41ff0e7959ab" (UID: "7651462c-af82-45db-af92-41ff0e7959ab"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:11:45.326174 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.326150    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7651462c-af82-45db-af92-41ff0e7959ab" (UID: "7651462c-af82-45db-af92-41ff0e7959ab"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:11:45.326292 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.326264    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk" (OuterVolumeSpecName: "kube-api-access-xrtkk") pod "7651462c-af82-45db-af92-41ff0e7959ab" (UID: "7651462c-af82-45db-af92-41ff0e7959ab"). InnerVolumeSpecName "kube-api-access-xrtkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:11:45.329010 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.328991    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7651462c-af82-45db-af92-41ff0e7959ab" (UID: "7651462c-af82-45db-af92-41ff0e7959ab"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:11:45.365459 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365429    2575 generic.go:356] "Generic (PLEG): container finished" podID="7651462c-af82-45db-af92-41ff0e7959ab" containerID="18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639" exitCode=2
Jul 08 07:11:45.365459 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365454    2575 generic.go:356] "Generic (PLEG): container finished" podID="7651462c-af82-45db-af92-41ff0e7959ab" containerID="46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2" exitCode=0
Jul 08 07:11:45.365893 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365487    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"
Jul 08 07:11:45.365893 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerDied","Data":"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"}
Jul 08 07:11:45.365893 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerDied","Data":"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"}
Jul 08 07:11:45.365893 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc" event={"ID":"7651462c-af82-45db-af92-41ff0e7959ab","Type":"ContainerDied","Data":"c0edf0bbb5eb5885f68943fa5f8443995eeb8a4e26aad65319ec45da60f7371b"}
Jul 08 07:11:45.365893 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.365626    2575 scope.go:117] "RemoveContainer" containerID="18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"
Jul 08 07:11:45.373941 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.373923    2575 scope.go:117] "RemoveContainer" containerID="46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"
Jul 08 07:11:45.381355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.381336    2575 scope.go:117] "RemoveContainer" containerID="756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"
Jul 08 07:11:45.389256 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.389229    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:11:45.389456 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.389436    2575 scope.go:117] "RemoveContainer" containerID="18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"
Jul 08 07:11:45.389782 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:11:45.389761    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639\": container with ID starting with 18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639 not found: ID does not exist" containerID="18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"
Jul 08 07:11:45.389860 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.389789    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"} err="failed to get container status \"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639\": rpc error: code = NotFound desc = could not find container \"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639\": container with ID starting with 18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639 not found: ID does not exist"
Jul 08 07:11:45.389860 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.389808    2575 scope.go:117] "RemoveContainer" containerID="46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"
Jul 08 07:11:45.390087 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:11:45.390069    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2\": container with ID starting with 46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2 not found: ID does not exist" containerID="46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"
Jul 08 07:11:45.390136 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"} err="failed to get container status \"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2\": rpc error: code = NotFound desc = could not find container \"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2\": container with ID starting with 46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2 not found: ID does not exist"
Jul 08 07:11:45.390136 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390108    2575 scope.go:117] "RemoveContainer" containerID="756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"
Jul 08 07:11:45.390349 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:11:45.390329    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f\": container with ID starting with 756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f not found: ID does not exist" containerID="756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"
Jul 08 07:11:45.390430 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390365    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"} err="failed to get container status \"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f\": rpc error: code = NotFound desc = could not find container \"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f\": container with ID starting with 756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f not found: ID does not exist"
Jul 08 07:11:45.390430 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390386    2575 scope.go:117] "RemoveContainer" containerID="18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"
Jul 08 07:11:45.390655 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390632    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639"} err="failed to get container status \"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639\": rpc error: code = NotFound desc = could not find container \"18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639\": container with ID starting with 18eb15f2835aae7a4ca526782111c277d673d7eeb02d35369c8244119578a639 not found: ID does not exist"
Jul 08 07:11:45.390725 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390655    2575 scope.go:117] "RemoveContainer" containerID="46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"
Jul 08 07:11:45.390882 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390864    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2"} err="failed to get container status \"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2\": rpc error: code = NotFound desc = could not find container \"46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2\": container with ID starting with 46885c8d784b3a3ce7fe28d4654e1c6a6459ea84576f062ce0e358a485e1c5b2 not found: ID does not exist"
Jul 08 07:11:45.390944 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.390882    2575 scope.go:117] "RemoveContainer" containerID="756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"
Jul 08 07:11:45.391110 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.391092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f"} err="failed to get container status \"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f\": rpc error: code = NotFound desc = could not find container \"756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f\": container with ID starting with 756c81ff3c411e8eb670ac0205bdf590099a263acb686ecea8ef5e93833f990f not found: ID does not exist"
Jul 08 07:11:45.391258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.391240    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-dfqsc"]
Jul 08 07:11:45.425663 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.425637    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7651462c-af82-45db-af92-41ff0e7959ab-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:11:45.425663 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.425663    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651462c-af82-45db-af92-41ff0e7959ab-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:11:45.425833 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.425674    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:11:45.425833 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.425685    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrtkk\" (UniqueName: \"kubernetes.io/projected/7651462c-af82-45db-af92-41ff0e7959ab-kube-api-access-xrtkk\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:11:45.425833 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:45.425694    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7651462c-af82-45db-af92-41ff0e7959ab-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:11:46.585254 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:46.585218    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7651462c-af82-45db-af92-41ff0e7959ab" path="/var/lib/kubelet/pods/7651462c-af82-45db-af92-41ff0e7959ab/volumes"
Jul 08 07:11:49.624476 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624443    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624797    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624812    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624832    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624840    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624845    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624853    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kube-rbac-proxy"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624860    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kube-rbac-proxy"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624872    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624877    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624884    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="storage-initializer"
Jul 08 07:11:49.624892 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624892    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="storage-initializer"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624904    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624912    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624924    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624930    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="storage-initializer"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.624960    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="storage-initializer"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625012    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625029    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="agent"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625036    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kserve-container"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625043    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f2684f-0224-47cd-9065-f78f946e8f4b" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625050    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kserve-container"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625055    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7651462c-af82-45db-af92-41ff0e7959ab" containerName="kube-rbac-proxy"
Jul 08 07:11:49.625258 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.625061    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcef51a-7637-4c81-8c8f-d49e49f80626" containerName="kserve-container"
Jul 08 07:11:49.657204 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.657168    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:11:49.657364 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.657287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.660590 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.660564    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:11:49.660751 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.660569    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:11:49.660751 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.660633    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:11:49.660869 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.660748    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-kube-rbac-proxy-sar-config\""
Jul 08 07:11:49.660869 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.660753    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:11:49.662331 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.662314    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:11:49.662426 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.662338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-predictor-serving-cert\""
Jul 08 07:11:49.764305 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.764276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.764305 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.764309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwvq\" (UniqueName: \"kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.764535 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.764332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.764535 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.764388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.764535 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.764449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865476 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865677 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865677 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwvq\" (UniqueName: \"kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865677 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865812 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.865947 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.865926    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.866252 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.866233    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.866331 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.866272    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.868049 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.868029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.874771 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.874712    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwvq\" (UniqueName: \"kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq\") pod \"isvc-autogluon-v2-predictor-67b849d456-ll4k5\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:49.966928 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:49.966891    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:50.113451 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:50.113425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:11:50.115051 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:11:50.115024    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cf4060_890c_4c10_a8f7_c05e75f1bef7.slice/crio-6d32972b0eae3869a7776e183119f86ec352d3d154df05ffe94f08fa28e0e46e WatchSource:0}: Error finding container 6d32972b0eae3869a7776e183119f86ec352d3d154df05ffe94f08fa28e0e46e: Status 404 returned error can't find the container with id 6d32972b0eae3869a7776e183119f86ec352d3d154df05ffe94f08fa28e0e46e
Jul 08 07:11:50.390378 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:50.390342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerStarted","Data":"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"}
Jul 08 07:11:50.390542 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:50.390403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerStarted","Data":"6d32972b0eae3869a7776e183119f86ec352d3d154df05ffe94f08fa28e0e46e"}
Jul 08 07:11:55.415155 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:55.415057    2575 generic.go:356] "Generic (PLEG): container finished" podID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerID="f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a" exitCode=0
Jul 08 07:11:55.415155 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:55.415103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerDied","Data":"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"}
Jul 08 07:11:56.421986 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:56.421951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerStarted","Data":"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"}
Jul 08 07:11:56.422462 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:56.422022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerStarted","Data":"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"}
Jul 08 07:11:56.422462 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:56.422255    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:11:56.441553 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:56.441474    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" podStartSLOduration=2.520799224 podStartE2EDuration="7.441455794s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.92065657s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:11:56.440326725 +0000 UTC m=+1016.559082538" watchObservedRunningTime="2026-07-08 07:11:56.441455794 +0000 UTC m=+1016.560211607"
Jul 08 07:11:57.426123 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:11:57.426092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:12:03.436369 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:12:03.436340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:13:30.586752 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:30.586680    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:13:39.737481 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:39.737450    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:13:39.738025 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:39.737717    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kserve-container" containerID="cri-o://531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703" gracePeriod=30
Jul 08 07:13:39.738025 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:39.737762    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kube-rbac-proxy" containerID="cri-o://5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad" gracePeriod=30
Jul 08 07:13:39.881733 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:39.881702    2575 generic.go:356] "Generic (PLEG): container finished" podID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerID="5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad" exitCode=2
Jul 08 07:13:39.881885 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:39.881756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerDied","Data":"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"}
Jul 08 07:13:40.579870 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.579848    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:13:40.634268 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls\") pod \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") "
Jul 08 07:13:40.634268 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location\") pod \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") "
Jul 08 07:13:40.634268 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634260    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config\") pod \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") "
Jul 08 07:13:40.634552 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhwvq\" (UniqueName: \"kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq\") pod \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") "
Jul 08 07:13:40.634552 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert\") pod \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\" (UID: \"96cf4060-890c-4c10-a8f7-c05e75f1bef7\") "
Jul 08 07:13:40.634758 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634736    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "96cf4060-890c-4c10-a8f7-c05e75f1bef7" (UID: "96cf4060-890c-4c10-a8f7-c05e75f1bef7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:13:40.634816 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.634762    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "96cf4060-890c-4c10-a8f7-c05e75f1bef7" (UID: "96cf4060-890c-4c10-a8f7-c05e75f1bef7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:13:40.636271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.636248    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "96cf4060-890c-4c10-a8f7-c05e75f1bef7" (UID: "96cf4060-890c-4c10-a8f7-c05e75f1bef7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:13:40.636380 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.636357    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq" (OuterVolumeSpecName: "kube-api-access-xhwvq") pod "96cf4060-890c-4c10-a8f7-c05e75f1bef7" (UID: "96cf4060-890c-4c10-a8f7-c05e75f1bef7"). InnerVolumeSpecName "kube-api-access-xhwvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:13:40.639160 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.639134    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "96cf4060-890c-4c10-a8f7-c05e75f1bef7" (UID: "96cf4060-890c-4c10-a8f7-c05e75f1bef7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:13:40.735501 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.735468    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhwvq\" (UniqueName: \"kubernetes.io/projected/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-api-access-xhwvq\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:13:40.735501 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.735494    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:13:40.735501 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.735503    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cf4060-890c-4c10-a8f7-c05e75f1bef7-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:13:40.735501 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.735511    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:13:40.735795 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.735520    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cf4060-890c-4c10-a8f7-c05e75f1bef7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:13:40.887937 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.887852    2575 generic.go:356] "Generic (PLEG): container finished" podID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerID="531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703" exitCode=0
Jul 08 07:13:40.887937 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.887890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerDied","Data":"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"}
Jul 08 07:13:40.887937 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.887920    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"
Jul 08 07:13:40.888490 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.887960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5" event={"ID":"96cf4060-890c-4c10-a8f7-c05e75f1bef7","Type":"ContainerDied","Data":"6d32972b0eae3869a7776e183119f86ec352d3d154df05ffe94f08fa28e0e46e"}
Jul 08 07:13:40.888490 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.887987    2575 scope.go:117] "RemoveContainer" containerID="5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"
Jul 08 07:13:40.896876 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.896861    2575 scope.go:117] "RemoveContainer" containerID="531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"
Jul 08 07:13:40.904019 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.904002    2575 scope.go:117] "RemoveContainer" containerID="f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"
Jul 08 07:13:40.911735 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.911713    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:13:40.913083 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913062    2575 scope.go:117] "RemoveContainer" containerID="5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"
Jul 08 07:13:40.913340 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:13:40.913324    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad\": container with ID starting with 5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad not found: ID does not exist" containerID="5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"
Jul 08 07:13:40.913400 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913347    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad"} err="failed to get container status \"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad\": rpc error: code = NotFound desc = could not find container \"5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad\": container with ID starting with 5e03b9b1f049fb120807cb847b670de093e8a66c70db4abc3967ee7a69b072ad not found: ID does not exist"
Jul 08 07:13:40.913400 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913363    2575 scope.go:117] "RemoveContainer" containerID="531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"
Jul 08 07:13:40.913646 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:13:40.913630    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703\": container with ID starting with 531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703 not found: ID does not exist" containerID="531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"
Jul 08 07:13:40.913705 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913649    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703"} err="failed to get container status \"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703\": rpc error: code = NotFound desc = could not find container \"531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703\": container with ID starting with 531759fb27fad231bab6e1bbf081ba1d88ce9fae73ec13ed1fa23daa0eff0703 not found: ID does not exist"
Jul 08 07:13:40.913705 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913670    2575 scope.go:117] "RemoveContainer" containerID="f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"
Jul 08 07:13:40.913839 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913820    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-ll4k5"]
Jul 08 07:13:40.913896 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:13:40.913881    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a\": container with ID starting with f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a not found: ID does not exist" containerID="f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"
Jul 08 07:13:40.913936 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:40.913899    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a"} err="failed to get container status \"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a\": rpc error: code = NotFound desc = could not find container \"f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a\": container with ID starting with f56b01d5dc696f8275f7f962e7cc07ab9b6cbe426feeaa14da4e0ec5f532412a not found: ID does not exist"
Jul 08 07:13:42.585072 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:42.585030    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" path="/var/lib/kubelet/pods/96cf4060-890c-4c10-a8f7-c05e75f1bef7/volumes"
Jul 08 07:13:44.891813 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.891785    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892118    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kube-rbac-proxy"
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892128    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kube-rbac-proxy"
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892142    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kserve-container"
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892147    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kserve-container"
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892154    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="storage-initializer"
Jul 08 07:13:44.892176 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892159    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="storage-initializer"
Jul 08 07:13:44.892382 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892219    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kube-rbac-proxy"
Jul 08 07:13:44.892382 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.892228    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96cf4060-890c-4c10-a8f7-c05e75f1bef7" containerName="kserve-container"
Jul 08 07:13:44.896211 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.896187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:44.899094 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.899063    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:13:44.899263 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.899242    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:13:44.900659 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.900639    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-predictor-serving-cert\""
Jul 08 07:13:44.900754 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.900679    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-kube-rbac-proxy-sar-config\""
Jul 08 07:13:44.900754 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.900749    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:13:44.900905 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.900885    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:13:44.901020 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.900928    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:13:44.908049 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.908028    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:13:44.975282 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.975227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:44.975486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.975294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdljx\" (UniqueName: \"kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:44.975486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.975379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:44.975486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.975422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:44.975486 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:44.975451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.075901 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.075865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.075909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdljx\" (UniqueName: \"kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.075977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.076041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076242 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.076075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076447 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.076421    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076641 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.076623    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.076856 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.076838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.078505 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.078486    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.084868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.084845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdljx\" (UniqueName: \"kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.209410 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.209313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:13:45.338031 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.337998    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:13:45.341182 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:13:45.341158    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b8db7f_e4ac_4928_bad7_783ea9dfd362.slice/crio-54fa904c57d83e1b9d07a025aec929f878616db70337ebe02d1f0062f9ee9931 WatchSource:0}: Error finding container 54fa904c57d83e1b9d07a025aec929f878616db70337ebe02d1f0062f9ee9931: Status 404 returned error can't find the container with id 54fa904c57d83e1b9d07a025aec929f878616db70337ebe02d1f0062f9ee9931
Jul 08 07:13:45.911549 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.911511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerStarted","Data":"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"}
Jul 08 07:13:45.911935 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:13:45.911583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerStarted","Data":"54fa904c57d83e1b9d07a025aec929f878616db70337ebe02d1f0062f9ee9931"}
Jul 08 07:14:15.037444 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:15.037407    2575 generic.go:356] "Generic (PLEG): container finished" podID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerID="d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc" exitCode=0
Jul 08 07:14:15.037897 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:15.037478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerDied","Data":"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"}
Jul 08 07:14:16.044006 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:16.043974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerStarted","Data":"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"}
Jul 08 07:14:16.044419 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:16.044035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerStarted","Data":"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"}
Jul 08 07:14:16.044419 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:16.044243    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:14:16.065516 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:16.065461    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" podStartSLOduration=3.057819203 podStartE2EDuration="32.065443473s" totalImagesPullingTime="0s" totalInitContainerRuntime="29.00762427s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:14:16.064919799 +0000 UTC m=+1156.183675643" watchObservedRunningTime="2026-07-08 07:14:16.065443473 +0000 UTC m=+1156.184199288"
Jul 08 07:14:17.048925 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:17.048894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:14:23.059039 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:14:23.058968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:15:52.585889 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:52.585805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:15:55.032280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.032244    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:15:55.032778 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.032540    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kserve-container" containerID="cri-o://c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b" gracePeriod=30
Jul 08 07:15:55.032778 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.032661    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kube-rbac-proxy" containerID="cri-o://72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f" gracePeriod=30
Jul 08 07:15:55.464576 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.464541    2575 generic.go:356] "Generic (PLEG): container finished" podID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerID="72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f" exitCode=2
Jul 08 07:15:55.464772 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.464593    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerDied","Data":"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"}
Jul 08 07:15:55.968213 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:55.968190    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:15:56.024876 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.024785    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls\") pod \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") "
Jul 08 07:15:56.024876 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.024826    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location\") pod \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") "
Jul 08 07:15:56.025099 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.024892    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert\") pod \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") "
Jul 08 07:15:56.025099 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.024930    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config\") pod \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") "
Jul 08 07:15:56.025099 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.024969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdljx\" (UniqueName: \"kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx\") pod \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\" (UID: \"30b8db7f-e4ac-4928-bad7-783ea9dfd362\") "
Jul 08 07:15:56.025290 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.025266    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "30b8db7f-e4ac-4928-bad7-783ea9dfd362" (UID: "30b8db7f-e4ac-4928-bad7-783ea9dfd362"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:15:56.025348 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.025270    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "30b8db7f-e4ac-4928-bad7-783ea9dfd362" (UID: "30b8db7f-e4ac-4928-bad7-783ea9dfd362"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:15:56.027061 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.027040    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "30b8db7f-e4ac-4928-bad7-783ea9dfd362" (UID: "30b8db7f-e4ac-4928-bad7-783ea9dfd362"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:15:56.027117 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.027100    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx" (OuterVolumeSpecName: "kube-api-access-jdljx") pod "30b8db7f-e4ac-4928-bad7-783ea9dfd362" (UID: "30b8db7f-e4ac-4928-bad7-783ea9dfd362"). InnerVolumeSpecName "kube-api-access-jdljx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:15:56.031062 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.031036    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "30b8db7f-e4ac-4928-bad7-783ea9dfd362" (UID: "30b8db7f-e4ac-4928-bad7-783ea9dfd362"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:15:56.126375 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.126326    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdljx\" (UniqueName: \"kubernetes.io/projected/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-api-access-jdljx\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:15:56.126375 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.126369    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30b8db7f-e4ac-4928-bad7-783ea9dfd362-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:15:56.126375 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.126383    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:15:56.126375 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.126392    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:15:56.126870 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.126402    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30b8db7f-e4ac-4928-bad7-783ea9dfd362-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:15:56.470156 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.470122    2575 generic.go:356] "Generic (PLEG): container finished" podID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerID="c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b" exitCode=0
Jul 08 07:15:56.470316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.470181    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"
Jul 08 07:15:56.470316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.470207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerDied","Data":"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"}
Jul 08 07:15:56.470316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.470270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v" event={"ID":"30b8db7f-e4ac-4928-bad7-783ea9dfd362","Type":"ContainerDied","Data":"54fa904c57d83e1b9d07a025aec929f878616db70337ebe02d1f0062f9ee9931"}
Jul 08 07:15:56.470316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.470299    2575 scope.go:117] "RemoveContainer" containerID="72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"
Jul 08 07:15:56.479531 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.479515    2575 scope.go:117] "RemoveContainer" containerID="c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"
Jul 08 07:15:56.486580 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.486565    2575 scope.go:117] "RemoveContainer" containerID="d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"
Jul 08 07:15:56.493432 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.493410    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:15:56.493783 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.493766    2575 scope.go:117] "RemoveContainer" containerID="72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"
Jul 08 07:15:56.494028 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:15:56.494009    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f\": container with ID starting with 72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f not found: ID does not exist" containerID="72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"
Jul 08 07:15:56.494079 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.494035    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f"} err="failed to get container status \"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f\": rpc error: code = NotFound desc = could not find container \"72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f\": container with ID starting with 72eed3053a54df7eb8f26bdc4e92ac1b26abafface98005b074b4df704d6402f not found: ID does not exist"
Jul 08 07:15:56.494079 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.494052    2575 scope.go:117] "RemoveContainer" containerID="c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"
Jul 08 07:15:56.494306 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:15:56.494253    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b\": container with ID starting with c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b not found: ID does not exist" containerID="c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"
Jul 08 07:15:56.494306 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.494280    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b"} err="failed to get container status \"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b\": rpc error: code = NotFound desc = could not find container \"c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b\": container with ID starting with c7c23a62df63631dc5ca6288c97649730be14ee5ce622437a66cc66d76aa777b not found: ID does not exist"
Jul 08 07:15:56.494306 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.494301    2575 scope.go:117] "RemoveContainer" containerID="d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"
Jul 08 07:15:56.495001 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:15:56.494959    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc\": container with ID starting with d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc not found: ID does not exist" containerID="d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"
Jul 08 07:15:56.495100 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.495002    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc"} err="failed to get container status \"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc\": rpc error: code = NotFound desc = could not find container \"d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc\": container with ID starting with d7711083bccee439fb8b87e0c6773a176d97f06f306d4c330b99cd52811a82cc not found: ID does not exist"
Jul 08 07:15:56.496973 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.496955    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-nnc8v"]
Jul 08 07:15:56.585353 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:15:56.585321    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" path="/var/lib/kubelet/pods/30b8db7f-e4ac-4928-bad7-783ea9dfd362/volumes"
Jul 08 07:16:00.184984 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.184949    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185303    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="storage-initializer"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185315    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="storage-initializer"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185329    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kube-rbac-proxy"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185334    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kube-rbac-proxy"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185343    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kserve-container"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185350    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kserve-container"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185405    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kube-rbac-proxy"
Jul 08 07:16:00.185514 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.185413    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b8db7f-e4ac-4928-bad7-783ea9dfd362" containerName="kserve-container"
Jul 08 07:16:00.188239 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.188219    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.191321 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.191299    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:16:00.191438 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.191331    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:16:00.191438 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.191347    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-kube-rbac-proxy-sar-config\""
Jul 08 07:16:00.191750 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.191737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:16:00.192896 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.192883    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-predictor-serving-cert\""
Jul 08 07:16:00.192970 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.192954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:16:00.193026 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.192984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:16:00.198931 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.198910    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:16:00.260217 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.260182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.260437 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.260224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.260437 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.260287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.260437 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.260304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.260437 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.260366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2jk\" (UniqueName: \"kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361142 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361142 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361345 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2jk\" (UniqueName: \"kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361345 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361345 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.361641 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.361594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.364427 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.364407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-kube-rbac-proxy-sar-config\""
Jul 08 07:16:00.364427 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.364417    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:16:00.364593 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.364500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-predictor-serving-cert\""
Jul 08 07:16:00.370042 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.370025    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:16:00.372573 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.372551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.372689 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.372587    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.374412 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.374396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.380870 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.380853    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:16:00.391035 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.391009    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2jk\" (UniqueName: \"kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.502613 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.502523    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:16:00.510256 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.510238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:00.642515 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.642485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:16:00.645544 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:16:00.645517    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f909a09_7554_481c_9b3c_42e72029eba9.slice/crio-0f6d92c84750be439087a235cfabf495b53ed1b2ed46ae5adadc7bda37c9359b WatchSource:0}: Error finding container 0f6d92c84750be439087a235cfabf495b53ed1b2ed46ae5adadc7bda37c9359b: Status 404 returned error can't find the container with id 0f6d92c84750be439087a235cfabf495b53ed1b2ed46ae5adadc7bda37c9359b
Jul 08 07:16:00.651065 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:00.651044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:16:01.494705 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:01.494675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerStarted","Data":"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"}
Jul 08 07:16:01.495077 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:01.494729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerStarted","Data":"0f6d92c84750be439087a235cfabf495b53ed1b2ed46ae5adadc7bda37c9359b"}
Jul 08 07:16:06.518585 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:06.518550    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f909a09-7554-481c-9b3c-42e72029eba9" containerID="1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef" exitCode=0
Jul 08 07:16:06.518974 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:06.518626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerDied","Data":"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"}
Jul 08 07:16:07.525655 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:07.525618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerStarted","Data":"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"}
Jul 08 07:16:07.526085 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:07.525688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerStarted","Data":"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"}
Jul 08 07:16:07.526085 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:07.525878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:07.554515 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:07.554464    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" podStartSLOduration=2.706579212 podStartE2EDuration="7.554448576s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.847869364s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:16:07.553304925 +0000 UTC m=+1267.672060734" watchObservedRunningTime="2026-07-08 07:16:07.554448576 +0000 UTC m=+1267.673204389"
Jul 08 07:16:08.533716 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:08.533687    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:16:14.544661 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:16:14.544634    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:17:42.586855 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:42.586778    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:17:50.300916 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:50.300878    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:17:50.301350 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:50.301208    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kube-rbac-proxy" containerID="cri-o://e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe" gracePeriod=30
Jul 08 07:17:50.301350 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:50.301251    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kserve-container" containerID="cri-o://61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d" gracePeriod=30
Jul 08 07:17:50.980618 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:50.980564    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f909a09-7554-481c-9b3c-42e72029eba9" containerID="e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe" exitCode=2
Jul 08 07:17:50.980795 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:50.980643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerDied","Data":"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"}
Jul 08 07:17:51.248423 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.248400    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:17:51.337858 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.337821    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location\") pod \"5f909a09-7554-481c-9b3c-42e72029eba9\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") "
Jul 08 07:17:51.337858 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.337870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config\") pod \"5f909a09-7554-481c-9b3c-42e72029eba9\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") "
Jul 08 07:17:51.338355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.337893    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert\") pod \"5f909a09-7554-481c-9b3c-42e72029eba9\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") "
Jul 08 07:17:51.338355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.337958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh2jk\" (UniqueName: \"kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk\") pod \"5f909a09-7554-481c-9b3c-42e72029eba9\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") "
Jul 08 07:17:51.338355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.337986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls\") pod \"5f909a09-7554-481c-9b3c-42e72029eba9\" (UID: \"5f909a09-7554-481c-9b3c-42e72029eba9\") "
Jul 08 07:17:51.338355 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.338262    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5f909a09-7554-481c-9b3c-42e72029eba9" (UID: "5f909a09-7554-481c-9b3c-42e72029eba9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:17:51.338508 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.338353    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "5f909a09-7554-481c-9b3c-42e72029eba9" (UID: "5f909a09-7554-481c-9b3c-42e72029eba9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:17:51.340068 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.340044    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5f909a09-7554-481c-9b3c-42e72029eba9" (UID: "5f909a09-7554-481c-9b3c-42e72029eba9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:17:51.340191 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.340170    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk" (OuterVolumeSpecName: "kube-api-access-wh2jk") pod "5f909a09-7554-481c-9b3c-42e72029eba9" (UID: "5f909a09-7554-481c-9b3c-42e72029eba9"). InnerVolumeSpecName "kube-api-access-wh2jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:17:51.342465 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.342446    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5f909a09-7554-481c-9b3c-42e72029eba9" (UID: "5f909a09-7554-481c-9b3c-42e72029eba9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:17:51.438531 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.438498    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh2jk\" (UniqueName: \"kubernetes.io/projected/5f909a09-7554-481c-9b3c-42e72029eba9-kube-api-access-wh2jk\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:17:51.438531 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.438525    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f909a09-7554-481c-9b3c-42e72029eba9-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:17:51.438531 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.438534    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f909a09-7554-481c-9b3c-42e72029eba9-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:17:51.438784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.438545    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:17:51.438784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.438555    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f909a09-7554-481c-9b3c-42e72029eba9-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:17:51.986698 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.986663    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f909a09-7554-481c-9b3c-42e72029eba9" containerID="61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d" exitCode=0
Jul 08 07:17:51.986868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.986720    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"
Jul 08 07:17:51.986868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.986743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerDied","Data":"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"}
Jul 08 07:17:51.986868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.986808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd" event={"ID":"5f909a09-7554-481c-9b3c-42e72029eba9","Type":"ContainerDied","Data":"0f6d92c84750be439087a235cfabf495b53ed1b2ed46ae5adadc7bda37c9359b"}
Jul 08 07:17:51.986868 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:51.986842    2575 scope.go:117] "RemoveContainer" containerID="e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"
Jul 08 07:17:52.002213 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.002192    2575 scope.go:117] "RemoveContainer" containerID="61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"
Jul 08 07:17:52.010119 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.010101    2575 scope.go:117] "RemoveContainer" containerID="1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"
Jul 08 07:17:52.013831 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.013804    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:17:52.018155 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.018135    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-czbfd"]
Jul 08 07:17:52.018696 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.018681    2575 scope.go:117] "RemoveContainer" containerID="e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"
Jul 08 07:17:52.018968 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:17:52.018950    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe\": container with ID starting with e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe not found: ID does not exist" containerID="e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"
Jul 08 07:17:52.019027 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.018975    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe"} err="failed to get container status \"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe\": rpc error: code = NotFound desc = could not find container \"e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe\": container with ID starting with e22d5ddf56cab728244e95df358bef5cf8ccf108e76a0c54b497f1aeb8d144fe not found: ID does not exist"
Jul 08 07:17:52.019027 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.018993    2575 scope.go:117] "RemoveContainer" containerID="61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"
Jul 08 07:17:52.019242 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:17:52.019225    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d\": container with ID starting with 61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d not found: ID does not exist" containerID="61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"
Jul 08 07:17:52.019280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.019249    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d"} err="failed to get container status \"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d\": rpc error: code = NotFound desc = could not find container \"61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d\": container with ID starting with 61fa6f5b352a515237967fc3403bab36098fdeefb577c9f6fd428ea4cdb6248d not found: ID does not exist"
Jul 08 07:17:52.019280 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.019265    2575 scope.go:117] "RemoveContainer" containerID="1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"
Jul 08 07:17:52.019515 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:17:52.019496    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef\": container with ID starting with 1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef not found: ID does not exist" containerID="1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"
Jul 08 07:17:52.019559 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.019522    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef"} err="failed to get container status \"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef\": rpc error: code = NotFound desc = could not find container \"1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef\": container with ID starting with 1d5564dcedfd8a180170d00204b47290aa6a100167f49cc2848b0137c86b29ef not found: ID does not exist"
Jul 08 07:17:52.585394 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:52.585361    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" path="/var/lib/kubelet/pods/5f909a09-7554-481c-9b3c-42e72029eba9/volumes"
Jul 08 07:17:55.457207 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457175    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457505    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kube-rbac-proxy"
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457516    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kube-rbac-proxy"
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457527    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="storage-initializer"
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457533    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="storage-initializer"
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457547    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kserve-container"
Jul 08 07:17:55.457572 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457553    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kserve-container"
Jul 08 07:17:55.457875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457641    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kserve-container"
Jul 08 07:17:55.457875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.457652    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f909a09-7554-481c-9b3c-42e72029eba9" containerName="kube-rbac-proxy"
Jul 08 07:17:55.461028 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.461004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.463706 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.463688    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-predictor-serving-cert\""
Jul 08 07:17:55.464068 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.464053    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:17:55.464124 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.464076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:17:55.464124 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.464082    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:17:55.464203 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.464053    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:17:55.465333 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.465302    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-kube-rbac-proxy-sar-config\""
Jul 08 07:17:55.465333 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.465328    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7zx2g\""
Jul 08 07:17:55.470448 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.470427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:17:55.572464 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.572431    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlx2\" (UniqueName: \"kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.572662 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.572482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.572662 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.572564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.572662 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.572627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.572662 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.572658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.673754 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.673713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.673754 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.673760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674017 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.673792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlx2\" (UniqueName: \"kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674017 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.673819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674017 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.673849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674194 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.674171    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674520 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.674498    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.674627 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.674501    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.676153 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.676136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.682726 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.682701    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlx2\" (UniqueName: \"kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.772563 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.772467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:17:55.903016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:55.902982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:17:55.905839 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:17:55.905811    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e050c9e_fca3_4dcc_a54e_9b6d1fd9a847.slice/crio-fda9a59251d9488dbf848b1f47c7169a4b27a3ca174dd68ddc146e529c270bdd WatchSource:0}: Error finding container fda9a59251d9488dbf848b1f47c7169a4b27a3ca174dd68ddc146e529c270bdd: Status 404 returned error can't find the container with id fda9a59251d9488dbf848b1f47c7169a4b27a3ca174dd68ddc146e529c270bdd
Jul 08 07:17:56.006234 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:56.006194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerStarted","Data":"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"}
Jul 08 07:17:56.006415 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:17:56.006261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerStarted","Data":"fda9a59251d9488dbf848b1f47c7169a4b27a3ca174dd68ddc146e529c270bdd"}
Jul 08 07:18:06.050735 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:06.050696    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerID="21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf" exitCode=0
Jul 08 07:18:06.051138 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:06.050750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerDied","Data":"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"}
Jul 08 07:18:07.057741 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:07.057708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerStarted","Data":"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"}
Jul 08 07:18:07.058123 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:07.057769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerStarted","Data":"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"}
Jul 08 07:18:07.058123 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:07.057954    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:07.078574 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:07.078510    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podStartSLOduration=2.697742929 podStartE2EDuration="12.078489489s" totalImagesPullingTime="0s" totalInitContainerRuntime="9.38074656s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:18:07.076755535 +0000 UTC m=+1387.195511348" watchObservedRunningTime="2026-07-08 07:18:07.078489489 +0000 UTC m=+1387.197245305"
Jul 08 07:18:08.062316 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:08.062289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:08.063667 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:08.063637    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:18:09.067007 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:09.066964    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:18:14.072611 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:14.072564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:14.073237 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:14.073209    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:18:24.073766 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:24.073733    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:25.510683 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:25.510645    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:18:25.511052 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:25.510861    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container" containerID="cri-o://cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84" gracePeriod=30
Jul 08 07:18:25.511052 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:25.510902    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kube-rbac-proxy" containerID="cri-o://7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3" gracePeriod=30
Jul 08 07:18:26.143912 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.143876    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerID="7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3" exitCode=2
Jul 08 07:18:26.144087 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.143955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerDied","Data":"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"}
Jul 08 07:18:26.459088 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.459066    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:26.554799 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.554762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert\") pod \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") "
Jul 08 07:18:26.555271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.554811    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config\") pod \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") "
Jul 08 07:18:26.555271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.554848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls\") pod \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") "
Jul 08 07:18:26.555271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.554895    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location\") pod \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") "
Jul 08 07:18:26.555271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.554960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xlx2\" (UniqueName: \"kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2\") pod \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\" (UID: \"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847\") "
Jul 08 07:18:26.555271 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.555167    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" (UID: "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:18:26.555765 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.555285    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" (UID: "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:18:26.556056 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.556036    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" (UID: "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:18:26.556966 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.556940    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" (UID: "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:18:26.557077 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.556993    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2" (OuterVolumeSpecName: "kube-api-access-9xlx2") pod "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" (UID: "6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847"). InnerVolumeSpecName "kube-api-access-9xlx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:18:26.656007 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.655965    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:18:26.656007 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.655998    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kserve-provision-location\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:18:26.656007 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.656007    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xlx2\" (UniqueName: \"kubernetes.io/projected/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-api-access-9xlx2\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:18:26.656007 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.656016    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-cabundle-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:18:26.656281 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:26.656026    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:18:27.149334 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.149296    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerID="cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84" exitCode=0
Jul 08 07:18:27.149543 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.149358    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"
Jul 08 07:18:27.149543 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.149380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerDied","Data":"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"}
Jul 08 07:18:27.149543 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.149453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc" event={"ID":"6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847","Type":"ContainerDied","Data":"fda9a59251d9488dbf848b1f47c7169a4b27a3ca174dd68ddc146e529c270bdd"}
Jul 08 07:18:27.149543 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.149490    2575 scope.go:117] "RemoveContainer" containerID="7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"
Jul 08 07:18:27.157551 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.157531    2575 scope.go:117] "RemoveContainer" containerID="cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"
Jul 08 07:18:27.164860 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.164826    2575 scope.go:117] "RemoveContainer" containerID="21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"
Jul 08 07:18:27.169275 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.169253    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:18:27.173573 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.173556    2575 scope.go:117] "RemoveContainer" containerID="7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"
Jul 08 07:18:27.173907 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:18:27.173886    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3\": container with ID starting with 7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3 not found: ID does not exist" containerID="7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"
Jul 08 07:18:27.173971 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.173915    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3"} err="failed to get container status \"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3\": rpc error: code = NotFound desc = could not find container \"7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3\": container with ID starting with 7cc2635da7f54f5d2311cf1b41fd86f465286cb995334a7b0f31231f47f4b4e3 not found: ID does not exist"
Jul 08 07:18:27.173971 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.173933    2575 scope.go:117] "RemoveContainer" containerID="cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"
Jul 08 07:18:27.174073 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.173971    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-xb7nc"]
Jul 08 07:18:27.174223 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:18:27.174207    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84\": container with ID starting with cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84 not found: ID does not exist" containerID="cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"
Jul 08 07:18:27.174261 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.174228    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84"} err="failed to get container status \"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84\": rpc error: code = NotFound desc = could not find container \"cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84\": container with ID starting with cc1711e87f93b5c2048d67b232a73a748edecde93ab4568d32a0f8acf5a7ab84 not found: ID does not exist"
Jul 08 07:18:27.174261 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.174243    2575 scope.go:117] "RemoveContainer" containerID="21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"
Jul 08 07:18:27.174475 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:18:27.174460    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf\": container with ID starting with 21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf not found: ID does not exist" containerID="21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"
Jul 08 07:18:27.174516 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:27.174479    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf"} err="failed to get container status \"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf\": rpc error: code = NotFound desc = could not find container \"21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf\": container with ID starting with 21690f4a74ea037a363429a9462a47f8c8454d17762a8af85da9991bd9bceacf not found: ID does not exist"
Jul 08 07:18:28.585322 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:28.585289    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" path="/var/lib/kubelet/pods/6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847/volumes"
Jul 08 07:18:31.963626 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.963570    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26pvk/must-gather-54hxr"]
Jul 08 07:18:31.964092 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964058    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container"
Jul 08 07:18:31.964092 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964075    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container"
Jul 08 07:18:31.964216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964101    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kube-rbac-proxy"
Jul 08 07:18:31.964216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964109    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kube-rbac-proxy"
Jul 08 07:18:31.964216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964125    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="storage-initializer"
Jul 08 07:18:31.964216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964134    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="storage-initializer"
Jul 08 07:18:31.964415 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964229    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kserve-container"
Jul 08 07:18:31.964415 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.964247    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e050c9e-fca3-4dcc-a54e-9b6d1fd9a847" containerName="kube-rbac-proxy"
Jul 08 07:18:31.967453 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.967433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:31.970307 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.970287    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pvk\"/\"kube-root-ca.crt\""
Jul 08 07:18:31.970422 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.970312    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26pvk\"/\"default-dockercfg-r2qrc\""
Jul 08 07:18:31.971897 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.971875    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pvk\"/\"openshift-service-ca.crt\""
Jul 08 07:18:31.974952 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:31.974928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pvk/must-gather-54hxr"]
Jul 08 07:18:32.004278 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.004251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t4sz\" (UniqueName: \"kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.004440 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.004315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.104936 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.104900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.105111 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.104987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t4sz\" (UniqueName: \"kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.105257 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.105237    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.113849 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.113822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t4sz\" (UniqueName: \"kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz\") pod \"must-gather-54hxr\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") " pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.284638 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.284525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:18:32.411676 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.411653    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pvk/must-gather-54hxr"]
Jul 08 07:18:32.413576 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:18:32.413548    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92374d51_95d7_4084_b7bc_f434558cb8fa.slice/crio-cf148ae1046b947774a42d68165072892636373b613b695ffa31724e04484b63 WatchSource:0}: Error finding container cf148ae1046b947774a42d68165072892636373b613b695ffa31724e04484b63: Status 404 returned error can't find the container with id cf148ae1046b947774a42d68165072892636373b613b695ffa31724e04484b63
Jul 08 07:18:32.415701 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:32.415684    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:18:33.180324 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:33.180286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pvk/must-gather-54hxr" event={"ID":"92374d51-95d7-4084-b7bc-f434558cb8fa","Type":"ContainerStarted","Data":"cf148ae1046b947774a42d68165072892636373b613b695ffa31724e04484b63"}
Jul 08 07:18:39.216696 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:39.216652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pvk/must-gather-54hxr" event={"ID":"92374d51-95d7-4084-b7bc-f434558cb8fa","Type":"ContainerStarted","Data":"10bc35a808f98ef282eed06a80d76f457e27064e0049bc6009cdf1a8bedb964d"}
Jul 08 07:18:39.216696 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:39.216697    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pvk/must-gather-54hxr" event={"ID":"92374d51-95d7-4084-b7bc-f434558cb8fa","Type":"ContainerStarted","Data":"b68392c92cd006f90f3c25f9cb1fab6334b35415180f31f74ccf8f6c4dc19a73"}
Jul 08 07:18:39.234651 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:39.234572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26pvk/must-gather-54hxr" podStartSLOduration=2.231073628 podStartE2EDuration="8.234556258s" totalImagesPullingTime="6.00348263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:18:39.233032542 +0000 UTC m=+1419.351788369" watchObservedRunningTime="2026-07-08 07:18:39.234556258 +0000 UTC m=+1419.353312113"
Jul 08 07:18:56.297623 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:56.297570    2575 generic.go:356] "Generic (PLEG): container finished" podID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerID="b68392c92cd006f90f3c25f9cb1fab6334b35415180f31f74ccf8f6c4dc19a73" exitCode=0
Jul 08 07:18:56.298058 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:56.297646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pvk/must-gather-54hxr" event={"ID":"92374d51-95d7-4084-b7bc-f434558cb8fa","Type":"ContainerDied","Data":"b68392c92cd006f90f3c25f9cb1fab6334b35415180f31f74ccf8f6c4dc19a73"}
Jul 08 07:18:56.298058 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:56.297964    2575 scope.go:117] "RemoveContainer" containerID="b68392c92cd006f90f3c25f9cb1fab6334b35415180f31f74ccf8f6c4dc19a73"
Jul 08 07:18:56.704088 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:56.704058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-26pvk_must-gather-54hxr_92374d51-95d7-4084-b7bc-f434558cb8fa/gather/0.log"
Jul 08 07:18:57.248489 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.248455    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqktm/must-gather-d62mw"]
Jul 08 07:18:57.251484 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.251467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.254444 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.254417    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqktm\"/\"kube-root-ca.crt\""
Jul 08 07:18:57.254669 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.254655    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqktm\"/\"openshift-service-ca.crt\""
Jul 08 07:18:57.254739 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.254719    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqktm\"/\"default-dockercfg-g456n\""
Jul 08 07:18:57.259938 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.259913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqktm/must-gather-d62mw"]
Jul 08 07:18:57.342294 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.342259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzrg\" (UniqueName: \"kubernetes.io/projected/c442b017-4a58-4e18-9570-b083195938c7-kube-api-access-bvzrg\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.342703 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.342369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c442b017-4a58-4e18-9570-b083195938c7-must-gather-output\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.443366 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.443331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c442b017-4a58-4e18-9570-b083195938c7-must-gather-output\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.443515 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.443377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzrg\" (UniqueName: \"kubernetes.io/projected/c442b017-4a58-4e18-9570-b083195938c7-kube-api-access-bvzrg\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.443712 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.443689    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c442b017-4a58-4e18-9570-b083195938c7-must-gather-output\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.451444 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.451419    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzrg\" (UniqueName: \"kubernetes.io/projected/c442b017-4a58-4e18-9570-b083195938c7-kube-api-access-bvzrg\") pod \"must-gather-d62mw\" (UID: \"c442b017-4a58-4e18-9570-b083195938c7\") " pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.561755 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.561669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqktm/must-gather-d62mw"
Jul 08 07:18:57.688262 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:57.688241    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqktm/must-gather-d62mw"]
Jul 08 07:18:57.689931 ip-10-0-136-197 kubenswrapper[2575]: W0708 07:18:57.689906    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc442b017_4a58_4e18_9570_b083195938c7.slice/crio-b272d2a306f65f0e0172b04b341dec7b30f80cdde3950130b1f978809e7c21c0 WatchSource:0}: Error finding container b272d2a306f65f0e0172b04b341dec7b30f80cdde3950130b1f978809e7c21c0: Status 404 returned error can't find the container with id b272d2a306f65f0e0172b04b341dec7b30f80cdde3950130b1f978809e7c21c0
Jul 08 07:18:58.306686 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:58.306651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqktm/must-gather-d62mw" event={"ID":"c442b017-4a58-4e18-9570-b083195938c7","Type":"ContainerStarted","Data":"b272d2a306f65f0e0172b04b341dec7b30f80cdde3950130b1f978809e7c21c0"}
Jul 08 07:18:59.313912 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:59.313869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqktm/must-gather-d62mw" event={"ID":"c442b017-4a58-4e18-9570-b083195938c7","Type":"ContainerStarted","Data":"efc03fd7de62086366b364160d5386c59d97109d01bfb75a0fe1f4bb9b89e8f0"}
Jul 08 07:18:59.314312 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:59.313927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqktm/must-gather-d62mw" event={"ID":"c442b017-4a58-4e18-9570-b083195938c7","Type":"ContainerStarted","Data":"00f6a7d2636d3c36a41b36f2530f071e9f8ac99ba92dfaabf2f5933cb3e384c1"}
Jul 08 07:18:59.330471 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:59.330409    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqktm/must-gather-d62mw" podStartSLOduration=1.400474411 podStartE2EDuration="2.33038978s" totalImagesPullingTime="929.915369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:18:59.329402719 +0000 UTC m=+1439.448158533" watchObservedRunningTime="2026-07-08 07:18:59.33038978 +0000 UTC m=+1439.449145618"
Jul 08 07:18:59.989767 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:18:59.989741    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-skqwb_06c0c990-684b-4c63-b72c-14ca0f92f66c/global-pull-secret-syncer/0.log"
Jul 08 07:19:00.185537 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:00.185509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-prr5j_ef00ac94-5ede-42c9-945a-f43d3e914a92/konnectivity-agent/0.log"
Jul 08 07:19:00.209932 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:00.209899    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-197.ec2.internal_d945e716ad71445b8b512961502b0cbc/haproxy/0.log"
Jul 08 07:19:02.096263 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.096222    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-26pvk/must-gather-54hxr"]
Jul 08 07:19:02.096784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.096472    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-26pvk/must-gather-54hxr" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="copy" containerID="cri-o://10bc35a808f98ef282eed06a80d76f457e27064e0049bc6009cdf1a8bedb964d" gracePeriod=2
Jul 08 07:19:02.103536 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.103505    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-26pvk/must-gather-54hxr"]
Jul 08 07:19:02.333885 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.332320    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-26pvk_must-gather-54hxr_92374d51-95d7-4084-b7bc-f434558cb8fa/copy/0.log"
Jul 08 07:19:02.333885 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.332726    2575 generic.go:356] "Generic (PLEG): container finished" podID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerID="10bc35a808f98ef282eed06a80d76f457e27064e0049bc6009cdf1a8bedb964d" exitCode=143
Jul 08 07:19:02.467065 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.466980    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-26pvk_must-gather-54hxr_92374d51-95d7-4084-b7bc-f434558cb8fa/copy/0.log"
Jul 08 07:19:02.476104 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.476028    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:19:02.480361 ip-10-0-136-197 kubenswrapper[2575]: E0708 07:19:02.480310    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-54hxr\" is forbidden: User \"system:node:ip-10-0-136-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-26pvk\": no relationship found between node 'ip-10-0-136-197.ec2.internal' and this object" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:19:02.596518 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.596479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output\") pod \"92374d51-95d7-4084-b7bc-f434558cb8fa\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") "
Jul 08 07:19:02.596831 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.596622    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t4sz\" (UniqueName: \"kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz\") pod \"92374d51-95d7-4084-b7bc-f434558cb8fa\" (UID: \"92374d51-95d7-4084-b7bc-f434558cb8fa\") "
Jul 08 07:19:02.598535 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.598500    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "92374d51-95d7-4084-b7bc-f434558cb8fa" (UID: "92374d51-95d7-4084-b7bc-f434558cb8fa"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:19:02.607164 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.606778    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz" (OuterVolumeSpecName: "kube-api-access-9t4sz") pod "92374d51-95d7-4084-b7bc-f434558cb8fa" (UID: "92374d51-95d7-4084-b7bc-f434558cb8fa"). InnerVolumeSpecName "kube-api-access-9t4sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:19:02.697681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.697564    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t4sz\" (UniqueName: \"kubernetes.io/projected/92374d51-95d7-4084-b7bc-f434558cb8fa-kube-api-access-9t4sz\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:19:02.697681 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:02.697623    2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92374d51-95d7-4084-b7bc-f434558cb8fa-must-gather-output\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\""
Jul 08 07:19:03.343152 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:03.343118    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-26pvk_must-gather-54hxr_92374d51-95d7-4084-b7bc-f434558cb8fa/copy/0.log"
Jul 08 07:19:03.343761 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:03.343578    2575 scope.go:117] "RemoveContainer" containerID="10bc35a808f98ef282eed06a80d76f457e27064e0049bc6009cdf1a8bedb964d"
Jul 08 07:19:03.343839 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:03.343761    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pvk/must-gather-54hxr"
Jul 08 07:19:03.380545 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:03.378185    2575 scope.go:117] "RemoveContainer" containerID="b68392c92cd006f90f3c25f9cb1fab6334b35415180f31f74ccf8f6c4dc19a73"
Jul 08 07:19:04.589270 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.589233    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" path="/var/lib/kubelet/pods/92374d51-95d7-4084-b7bc-f434558cb8fa/volumes"
Jul 08 07:19:04.640279 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.640204    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/alertmanager/0.log"
Jul 08 07:19:04.667081 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.667053    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/config-reloader/0.log"
Jul 08 07:19:04.695804 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.695769    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/kube-rbac-proxy-web/0.log"
Jul 08 07:19:04.725142 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.725115    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/kube-rbac-proxy/0.log"
Jul 08 07:19:04.749784 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.749697    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/kube-rbac-proxy-metric/0.log"
Jul 08 07:19:04.777049 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.776917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/prom-label-proxy/0.log"
Jul 08 07:19:04.803825 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.803796    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_518d05d5-f3a0-40c9-aeef-7a8e7b89799e/init-config-reloader/0.log"
Jul 08 07:19:04.877457 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.877430    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-spzx2_0f04d47b-256f-4fc7-ac8f-d87766199cd3/kube-state-metrics/0.log"
Jul 08 07:19:04.902508 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.902364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-spzx2_0f04d47b-256f-4fc7-ac8f-d87766199cd3/kube-rbac-proxy-main/0.log"
Jul 08 07:19:04.929526 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.929494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-spzx2_0f04d47b-256f-4fc7-ac8f-d87766199cd3/kube-rbac-proxy-self/0.log"
Jul 08 07:19:04.964993 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.964938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58494f5f75-qzm2s_1ee408f8-14e6-4518-b6ff-127bee76cae1/metrics-server/0.log"
Jul 08 07:19:04.991051 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:04.991023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-s6ds2_079eb02e-5c25-41e4-ad1d-e5ef7b5e8271/monitoring-plugin/0.log"
Jul 08 07:19:05.029164 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.029132    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffj6m_7ec80f09-27cd-423f-874d-c332e594a215/node-exporter/0.log"
Jul 08 07:19:05.051022 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.050989    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffj6m_7ec80f09-27cd-423f-874d-c332e594a215/kube-rbac-proxy/0.log"
Jul 08 07:19:05.076184 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.076142    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffj6m_7ec80f09-27cd-423f-874d-c332e594a215/init-textfile/0.log"
Jul 08 07:19:05.271875 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.271795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s69th_4eae69ee-f49f-4777-bb18-eaf69dd89900/kube-rbac-proxy-main/0.log"
Jul 08 07:19:05.294016 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.293965    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s69th_4eae69ee-f49f-4777-bb18-eaf69dd89900/kube-rbac-proxy-self/0.log"
Jul 08 07:19:05.315347 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.315319    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s69th_4eae69ee-f49f-4777-bb18-eaf69dd89900/openshift-state-metrics/0.log"
Jul 08 07:19:05.352702 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.352670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/prometheus/0.log"
Jul 08 07:19:05.385097 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.385071    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/config-reloader/0.log"
Jul 08 07:19:05.409025 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.408997    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/thanos-sidecar/0.log"
Jul 08 07:19:05.433281 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.433242    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/kube-rbac-proxy-web/0.log"
Jul 08 07:19:05.473968 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.473938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/kube-rbac-proxy/0.log"
Jul 08 07:19:05.495944 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.495912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/kube-rbac-proxy-thanos/0.log"
Jul 08 07:19:05.517478 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.517441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7cb2e58-5c1c-49df-a81b-f17d5ea3a3a6/init-config-reloader/0.log"
Jul 08 07:19:05.545451 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.545371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-lzkjv_11dd47e9-0f68-4de8-ad1f-58b79433fbb6/prometheus-operator/0.log"
Jul 08 07:19:05.563522 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.563497    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-lzkjv_11dd47e9-0f68-4de8-ad1f-58b79433fbb6/kube-rbac-proxy/0.log"
Jul 08 07:19:05.633843 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.633782    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b59749fc6-6r8zh_3a463b72-e502-47ad-920e-801d4a2cb2bf/telemeter-client/0.log"
Jul 08 07:19:05.659108 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.659081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b59749fc6-6r8zh_3a463b72-e502-47ad-920e-801d4a2cb2bf/reload/0.log"
Jul 08 07:19:05.682415 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.682392    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b59749fc6-6r8zh_3a463b72-e502-47ad-920e-801d4a2cb2bf/kube-rbac-proxy/0.log"
Jul 08 07:19:05.711099 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.711068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/thanos-query/0.log"
Jul 08 07:19:05.735636 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.735575    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/kube-rbac-proxy-web/0.log"
Jul 08 07:19:05.761225 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.761192    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/kube-rbac-proxy/0.log"
Jul 08 07:19:05.781249 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.781221    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/prom-label-proxy/0.log"
Jul 08 07:19:05.804139 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.804058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/kube-rbac-proxy-rules/0.log"
Jul 08 07:19:05.826516 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:05.826491    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4b987597-j2fr4_209289bf-d08c-42ff-b61c-036ed69ee52d/kube-rbac-proxy-metrics/0.log"
Jul 08 07:19:08.620068 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620035    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"]
Jul 08 07:19:08.620721 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620523    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="gather"
Jul 08 07:19:08.620721 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620541    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="gather"
Jul 08 07:19:08.620721 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620582    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="copy"
Jul 08 07:19:08.620721 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620591    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="copy"
Jul 08 07:19:08.620990 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620727    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="gather"
Jul 08 07:19:08.620990 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.620749    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="92374d51-95d7-4084-b7bc-f434558cb8fa" containerName="copy"
Jul 08 07:19:08.627731 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.627703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.633487 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.633461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"]
Jul 08 07:19:08.674109 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.674066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-podres\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.674383 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.674360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-sys\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.674543 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.674515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-proc\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.674695 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.674620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-lib-modules\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.674695 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.674653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4rj\" (UniqueName: \"kubernetes.io/projected/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-kube-api-access-rc4rj\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775610 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-lib-modules\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775610 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4rj\" (UniqueName: \"kubernetes.io/projected/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-kube-api-access-rc4rj\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-podres\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-sys\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-proc\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775739    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-lib-modules\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775768    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-podres\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.775830 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775807    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-proc\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.776041 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.775855    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-sys\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.784516 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.784490    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4rj\" (UniqueName: \"kubernetes.io/projected/c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d-kube-api-access-rc4rj\") pod \"perf-node-gather-daemonset-gd52h\" (UID: \"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d\") " pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:08.942296 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:08.942210    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:09.110000 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.109897    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"]
Jul 08 07:19:09.382089 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.382054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h" event={"ID":"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d","Type":"ContainerStarted","Data":"77b70bdc74572ad128ab7c5fc03d169d384046cfb78f358a2cdba6c1fd760eb2"}
Jul 08 07:19:09.382264 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.382115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h" event={"ID":"c8ce765e-9ca5-44ea-ae92-e9596b5a5c3d","Type":"ContainerStarted","Data":"f2d6aa970e341a40000959c6e0a93d386e4780373e6280cece814bb6200f11ea"}
Jul 08 07:19:09.382264 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.382146    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:09.399496 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.399432    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h" podStartSLOduration=1.399410844 podStartE2EDuration="1.399410844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 07:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:19:09.398719273 +0000 UTC m=+1449.517475086" watchObservedRunningTime="2026-07-08 07:19:09.399410844 +0000 UTC m=+1449.518166659"
Jul 08 07:19:09.595214 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.595136    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8s78r_ee4a719b-7ddc-4876-9747-b45d4bee4f13/dns/0.log"
Jul 08 07:19:09.617947 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.617923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8s78r_ee4a719b-7ddc-4876-9747-b45d4bee4f13/kube-rbac-proxy/0.log"
Jul 08 07:19:09.754958 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:09.754934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4hct_452a1aec-bbf8-46ff-9742-4af49a2252c0/dns-node-resolver/0.log"
Jul 08 07:19:10.298267 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:10.298234    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqxfd_b9d0d000-b483-46a4-a0ec-f4b2def312ce/node-ca/0.log"
Jul 08 07:19:11.538967 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:11.538937    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x25g4_9ed3e11d-cdf9-40ad-9b14-dfc0143bb592/serve-healthcheck-canary/0.log"
Jul 08 07:19:11.956668 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:11.956640    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swt9c_cda7b995-af58-4184-9b94-840fbfd5eeff/kube-rbac-proxy/0.log"
Jul 08 07:19:11.980067 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:11.980039    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swt9c_cda7b995-af58-4184-9b94-840fbfd5eeff/exporter/0.log"
Jul 08 07:19:12.001811 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:12.001779    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swt9c_cda7b995-af58-4184-9b94-840fbfd5eeff/extractor/0.log"
Jul 08 07:19:14.200090 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.200041    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-xvh5c_4982a5bd-96f8-4610-87a4-722fb3e56051/manager/0.log"
Jul 08 07:19:14.230266 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.230237    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9hbr6_c56674d7-1338-4a0e-80ab-911abb829e71/s3-init/0.log"
Jul 08 07:19:14.245056 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.245020    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9hbr6_c56674d7-1338-4a0e-80ab-911abb829e71/download-hf-model/0.log"
Jul 08 07:19:14.271553 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.271529    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-fbcnp_d563e03a-6012-4443-8d19-e0adbaf708c9/s3-tls-init-custom/0.log"
Jul 08 07:19:14.285547 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.285520    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-fbcnp_d563e03a-6012-4443-8d19-e0adbaf708c9/download-hf-model/0.log"
Jul 08 07:19:14.311483 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.311455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-qcxxc_6ffe8425-e24a-42a7-bd02-911e87a0a325/s3-tls-init-serving/0.log"
Jul 08 07:19:14.327310 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.327282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-qcxxc_6ffe8425-e24a-42a7-bd02-911e87a0a325/download-hf-model/0.log"
Jul 08 07:19:14.377821 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:14.377784    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-76flw_9d8b19d4-50e7-41d4-8df5-cefb4b357007/seaweedfs-tls-custom/0.log"
Jul 08 07:19:15.396967 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:15.396941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqktm/perf-node-gather-daemonset-gd52h"
Jul 08 07:19:19.654895 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.654859    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6glws_e6628049-8079-4b83-a503-b1e420812d90/kube-multus/0.log"
Jul 08 07:19:19.855348 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.855320    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/kube-multus-additional-cni-plugins/0.log"
Jul 08 07:19:19.876216 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.876184    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/egress-router-binary-copy/0.log"
Jul 08 07:19:19.897820 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.897793    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/cni-plugins/0.log"
Jul 08 07:19:19.917334 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.917248    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/bond-cni-plugin/0.log"
Jul 08 07:19:19.936975 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.936931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/routeoverride-cni/0.log"
Jul 08 07:19:19.957780 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.957745    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/whereabouts-cni-bincopy/0.log"
Jul 08 07:19:19.985447 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:19.985424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqkg5_fa9f2f45-a6b7-4140-b3e8-901947a626d0/whereabouts-cni/0.log"
Jul 08 07:19:20.227399 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:20.227328    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vz9q_01f6bcfb-15ec-4bf9-aef0-4a71484678b3/network-metrics-daemon/0.log"
Jul 08 07:19:20.246581 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:20.246559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vz9q_01f6bcfb-15ec-4bf9-aef0-4a71484678b3/kube-rbac-proxy/0.log"
Jul 08 07:19:21.200666 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.200642    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/ovn-controller/0.log"
Jul 08 07:19:21.220075 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.220052    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/ovn-acl-logging/0.log"
Jul 08 07:19:21.246980 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.246954    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/kube-rbac-proxy-node/0.log"
Jul 08 07:19:21.270780 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.270752    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 07:19:21.294690 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.294665    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/northd/0.log"
Jul 08 07:19:21.315347 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.315313    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/nbdb/0.log"
Jul 08 07:19:21.340134 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.340090    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/sbdb/0.log"
Jul 08 07:19:21.388278 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:21.388245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ctjb4_7c3c3f2a-bc18-43ab-9fe1-d097af1e5ea3/ovnkube-controller/0.log"
Jul 08 07:19:22.620398 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:22.620372    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-w7pwd_50692790-2ff1-4001-81ee-bfbe0d9e5a5d/network-check-target-container/0.log"
Jul 08 07:19:23.565655 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:23.565626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9jmhw_4b3b5d5d-5e57-43b6-b2fd-671938eb3e09/iptables-alerter/0.log"
Jul 08 07:19:24.224300 ip-10-0-136-197 kubenswrapper[2575]: I0708 07:19:24.224272    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-55vzr_fb56b3db-aa4e-4ddd-a98d-fa075f61a7db/tuned/0.log"