Jul 21 08:54:24.414642 ip-10-0-128-156 systemd[1]: Starting Kubernetes Kubelet... Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.793582 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798445 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798458 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798462 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798465 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798468 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798471 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798474 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:24.866225 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798478 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798482 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798485 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798488 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798490 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798494 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798497 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798499 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798502 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798505 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798508 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798510 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798513 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798515 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798519 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798522 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798524 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798527 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798530 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798532 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:24.867251 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798535 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798537 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798540 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798543 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798546 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798549 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798551 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798554 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798556 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798560 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798562 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798566 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798569 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798571 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798574 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798576 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798579 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798581 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798584 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798586 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:24.867855 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798589 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798591 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798594 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798596 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798600 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798602 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798605 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798608 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798611 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798614 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798616 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798621 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798623 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798626 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798629 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798631 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798634 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798639 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798643 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:24.868477 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798646 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798649 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798652 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798655 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798657 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798660 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798663 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798666 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798669 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798672 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798675 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798677 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798680 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798682 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798685 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798691 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798694 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798697 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798700 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:24.869104 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798703 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798706 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798708 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798711 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798715 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798719 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798723 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798725 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798728 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798730 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798733 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798736 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798738 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.798741 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801278 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801286 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801290 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801293 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801296 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801299 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:24.869658 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801303 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801305 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801308 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801311 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801313 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801316 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801319 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801321 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801324 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801346 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801349 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801352 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801354 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801357 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801361 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801367 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801370 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801373 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801376 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:24.870208 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801379 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801382 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801384 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801387 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801389 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801392 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801394 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801397 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801400 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801402 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801404 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801407 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801409 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801416 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801419 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801421 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801426 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801429 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801432 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:24.870782 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801434 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801437 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801440 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801443 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801446 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801448 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801451 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801453 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801457 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801459 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801462 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801464 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801467 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801469 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801472 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801474 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801477 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801479 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801482 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:24.871363 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801486 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801489 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801492 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801494 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801497 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801499 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801502 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801505 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801509 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801512 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801514 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801517 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801521 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801523 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801526 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801528 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801531 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801533 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801536 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801538 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:24.871857 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801540 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801544 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801547 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801550 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801553 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801555 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801558 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801561 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801563 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801566 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801569 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801572 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801577 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801579 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801582 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801958 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801964 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801967 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801969 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:24.872660 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801975 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801978 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801980 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801983 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801985 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801988 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801990 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801993 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801996 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.801999 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802001 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802004 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802006 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802008 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802013 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802015 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802034 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802038 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802041 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802044 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:24.873471 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802047 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802049 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802052 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802055 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802058 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802063 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802066 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802069 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802071 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802074 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802077 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802079 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802082 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802085 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802088 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802091 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802093 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802096 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802098 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:24.874031 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802101 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802103 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802106 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802108 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802110 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802114 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802118 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802122 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802124 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802127 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802129 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802132 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802135 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802137 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802140 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802142 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802144 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802147 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802152 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802156 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:24.874615 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802158 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802161 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802163 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802166 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802168 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802170 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802173 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802176 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802178 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802181 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802183 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802187 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802191 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802194 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802197 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802199 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802202 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802204 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802207 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:24.875273 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802210 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802213 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802216 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802218 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802220 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802223 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802226 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802230 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802232 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802235 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802238 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802241 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802245 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802248 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802251 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802255 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802257 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802323 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802350 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802359 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802365 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 08:54:24.875807 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802370 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802373 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802377 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802381 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802385 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802388 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802391 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802394 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802397 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802400 2576 flags.go:64] FLAG: --cgroup-root="" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802403 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802408 2576 flags.go:64] FLAG: --client-ca-file="" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802411 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802413 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802417 2576 flags.go:64] FLAG: --cluster-domain="" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802420 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802423 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802426 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802430 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802433 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802436 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802439 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802444 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802447 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 21 08:54:24.876396 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802450 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802453 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802456 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802459 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802463 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802466 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802469 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802472 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802475 2576 flags.go:64] FLAG: --enable-server="true" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802478 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802482 2576 flags.go:64] FLAG: --event-burst="100" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802485 2576 flags.go:64] FLAG: --event-qps="50" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802488 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802491 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802494 2576 flags.go:64] FLAG: --eviction-hard="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802497 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802500 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802503 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802518 2576 flags.go:64] FLAG: --eviction-soft="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802523 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802527 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802530 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802533 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802536 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802539 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 08:54:24.877104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802542 2576 flags.go:64] FLAG: --feature-gates="" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802546 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802549 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802552 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802555 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802559 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802562 2576 flags.go:64] FLAG: --help="false" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802565 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-156.ec2.internal" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802568 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802571 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802574 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802577 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802581 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802583 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802587 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802589 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802592 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802596 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802599 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802602 2576 flags.go:64] FLAG: --kube-reserved="" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802605 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802608 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802611 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802613 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 08:54:24.877969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802616 2576 flags.go:64] FLAG: --lock-file="" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802619 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802623 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802626 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802631 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802635 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802638 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802640 2576 flags.go:64] FLAG: --logging-format="text" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802643 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802646 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802649 2576 flags.go:64] FLAG: --manifest-url="" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802652 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802661 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802666 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802670 2576 flags.go:64] FLAG: --max-pods="110" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802673 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802676 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802679 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802682 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802685 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802688 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802691 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802697 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802700 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802703 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 08:54:24.881085 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802706 2576 flags.go:64] FLAG: --pod-cidr="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802710 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802715 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802718 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802721 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802724 2576 flags.go:64] FLAG: --port="10250" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802727 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802730 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf4ef9eb4e155fc3" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802733 2576 flags.go:64] FLAG: --qos-reserved="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802736 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802740 2576 flags.go:64] FLAG: --register-node="true" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802743 2576 flags.go:64] FLAG: --register-with-taints="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802747 2576 flags.go:64] FLAG: --registry-burst="10" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802750 2576 flags.go:64] FLAG: --registry-qps="5" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802752 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802755 2576 flags.go:64] FLAG: --reserved-memory="" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802759 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802762 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802765 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802768 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802772 2576 flags.go:64] FLAG: --runonce="false" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802774 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802777 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802780 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802783 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 08:54:24.881925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802786 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802789 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802792 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802795 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802797 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802800 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802803 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802806 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802809 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802812 2576 flags.go:64] FLAG: --system-cgroups="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802815 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802820 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802823 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802826 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802829 2576 flags.go:64] FLAG: --tls-min-version="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802832 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802835 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802838 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802841 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802844 2576 flags.go:64] FLAG: --v="2" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802848 2576 flags.go:64] FLAG: --version="false" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802852 2576 flags.go:64] FLAG: --vmodule="" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802855 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.802859 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802964 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:25.024559 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802968 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:24.883674 ip-10-0-128-156 systemd[1]: Started Kubernetes Kubelet. Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802970 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802975 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802978 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802981 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802983 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802986 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802988 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.802991 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803002 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803005 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803008 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803011 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803014 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803017 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803020 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803023 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803027 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803030 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:25.039713 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803033 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803036 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803039 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803042 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803045 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803049 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803051 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803054 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803056 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803059 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803062 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803064 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803067 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803069 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803072 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803076 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803078 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803081 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803083 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803086 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:25.040661 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803089 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803091 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803094 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803096 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803099 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803101 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803104 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803106 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803108 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803111 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803114 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803117 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803119 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803122 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803124 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803127 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803129 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803133 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803135 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:25.041428 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803138 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803140 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803144 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803147 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803150 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803153 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803155 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803158 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803162 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803165 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803167 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803170 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803172 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803175 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803177 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803180 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803183 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803185 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803188 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803190 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:25.042006 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803193 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803196 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803198 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803201 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803204 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803206 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803209 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803212 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803214 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803217 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803221 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803223 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803226 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803229 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803232 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803236 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803238 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803241 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803243 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:25.042662 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.803246 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.803807 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.817614 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.817632 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.818440 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.818449 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818510 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818517 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818521 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818524 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818527 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818530 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818534 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818537 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818539 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:25.043236 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818542 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818545 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818547 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818550 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818553 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818555 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818558 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818560 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818563 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818565 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818568 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818570 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818574 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818576 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818580 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818583 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818585 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818588 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818592 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818594 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:25.043797 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818597 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818602 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818606 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818609 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818613 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818616 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818618 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818621 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818624 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818627 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818630 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818633 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818636 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818638 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818642 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818644 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818647 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818650 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818653 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:25.044399 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818656 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818660 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818664 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818667 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818669 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818673 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818676 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818679 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818682 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818685 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818688 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818691 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818693 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818697 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818699 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818702 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818705 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818712 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818715 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:25.045019 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818717 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818720 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818723 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818725 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818728 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818730 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818734 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818738 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818740 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818743 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818746 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818749 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818753 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818755 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818758 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818760 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818763 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818766 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818769 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:25.045606 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818771 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818774 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818777 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818779 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818782 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818784 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818787 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818789 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818792 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818794 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818797 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818801 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818804 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.818809 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818926 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:25.046229 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818931 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818934 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818937 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818940 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818945 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818948 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818950 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818953 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818956 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818958 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818961 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818964 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818966 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818969 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818972 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818974 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818977 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818980 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818982 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:25.046720 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818986 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818990 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818993 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818996 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.818999 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819002 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819005 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819007 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819010 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819012 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819016 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819019 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819021 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819024 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819027 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819029 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819032 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819036 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819039 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819041 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:25.047274 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819044 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819047 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819050 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819052 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819055 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819058 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819060 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819063 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819066 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819068 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819070 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819073 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819076 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819078 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819081 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819083 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819086 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819088 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819091 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819093 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:25.047869 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819096 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819098 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819102 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819105 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819107 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819110 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819112 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819115 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819117 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819122 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819126 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819129 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819132 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819135 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819138 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819141 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819144 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819146 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819149 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:25.048457 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819152 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819156 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819159 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819163 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819165 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819168 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819170 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819173 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819176 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819179 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819181 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819184 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819186 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819189 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819191 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819195 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819197 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819200 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819203 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:25.048985 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:24.819205 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.819210 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.819343 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.821301 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.822550 2576 server.go:1019] "Starting client certificate rotation" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.822651 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.822694 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.825365 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.828050 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.838696 2576 log.go:25] "Validated CRI v1 runtime API" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.840668 2576 log.go:25] "Validated CRI v1 image API" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.841401 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 08:54:25.049548 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.843734 2576 fs.go:135] Filesystem UUIDs: map[15119e26-faee-4561-a68c-73a8b28b86a2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8badd6cc-9e5c-4df5-8a8b-b78195a01f3f:/dev/nvme0n1p3] Jul 21 08:54:25.049899 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.843759 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.852916 2576 manager.go:216] Machine: {Timestamp:2026-07-21 08:54:24.852070164 +0000 UTC m=+0.329053586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3051812 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26267137737d7f97a5e448352ad2dd SystemUUID:ec262671-3773-7d7f-97a5-e448352ad2dd BootID:a5b69cef-b8ec-4120-98a1-73c4e4e402ec Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:c5:68:a1:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:c5:68:a1:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:cb:81:a7:f7:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.853016 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.853092 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.854077 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.855733 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.855768 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 08:54:25.050004 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.857054 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.857066 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.857074 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.857995 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.859188 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862182 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862298 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862340 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862352 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862364 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862373 2576 kubelet.go:398] "Adding apiserver pod source" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862382 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862724 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.862739 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.864646 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.865935 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.865962 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873484 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873499 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873505 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873510 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873518 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873523 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873534 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873542 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873551 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873557 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873567 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.873572 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.874356 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.874367 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.874948 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.875055 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.877506 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t654j" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.882785 2576 server.go:1268] "Started kubelet" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.882851 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.882894 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.883012 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.883186 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t654j" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.883954 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 08:54:26.341666 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.884882 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.885834 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.889477 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.890636 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.890647 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.890714 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891269 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891319 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891348 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891408 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891418 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891461 2576 factory.go:55] Registering systemd factory Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891473 2576 factory.go:223] Registration of the systemd container factory successfully Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891701 2576 factory.go:153] Registering CRI-O factory Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891712 2576 factory.go:223] Registration of the crio container factory successfully Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891756 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891776 2576 factory.go:103] Registering Raw factory Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.891789 2576 manager.go:1196] Started watching for new ooms in manager Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.892503 2576 manager.go:349] Starting recovery of all containers Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.901813 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.905895 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-156.ec2.internal\" not found" node="ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.915492 2576 manager.go:354] Recovery completed Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.919324 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.924217 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.924246 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.924278 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.925309 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.925322 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.925355 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.925386 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926190 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926216 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926226 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926358 2576 policy_none.go:49] "None policy: Start" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926371 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.926380 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.927225 2576 policy_none.go:47] "Start" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.954943 2576 manager.go:337] "Starting Device Plugin manager" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.954977 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.954985 2576 server.go:87] "Starting device plugin registration server" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.955237 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.955250 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 08:54:26.343191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.955359 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.955628 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:24.955640 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.955895 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:24.955942 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.056114 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.057037 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.057068 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.057080 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.057107 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.063621 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:25.063642 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-156.ec2.internal\": node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.066248 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.067485 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.067528 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.067553 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:25.067593 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:25.069861 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.200552 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.292366 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal"] Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.292448 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.294190 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.294218 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.294231 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.296061 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.296171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.296198 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297021 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297044 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297023 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297055 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297067 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.297079 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.298918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.298939 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:26.345325 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.300580 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.301566 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.301589 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.301600 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.318476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.318496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.318512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07256174ce2a892eccda8c227b08f27a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"07256174ce2a892eccda8c227b08f27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.318567 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-156.ec2.internal\" not found" node="ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.346379 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.322926 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-156.ec2.internal\" not found" node="ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.400778 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07256174ce2a892eccda8c227b08f27a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"07256174ce2a892eccda8c227b08f27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07256174ce2a892eccda8c227b08f27a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"07256174ce2a892eccda8c227b08f27a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.418831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b119993a5741f2205909a771ac760fdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"b119993a5741f2205909a771ac760fdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.547306 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.501295 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.694306 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.601787 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.694306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.620184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.694306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.626514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:26.900564 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.702665 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.900564 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.803378 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:26.900564 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.822898 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:26.903772 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.946280 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.946414 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.946443 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:26.946443 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:27.004774 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.011669 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 08:49:26 +0000 UTC" deadline="2028-01-19 05:33:30.713989994 +0000 UTC" Jul 21 08:54:27.079741 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.011710 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13124h39m3.702282946s" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:27.104921 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.113247 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.114678 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.128718 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.129849 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.138858 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:27.221199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb119993a5741f2205909a771ac760fdc.slice/crio-410d9aad289566dc44d667f2c4af0a36bd31a6546e8d9b32a0bcf3594ef018dd WatchSource:0}: Error finding container 410d9aad289566dc44d667f2c4af0a36bd31a6546e8d9b32a0bcf3594ef018dd: Status 404 returned error can't find the container with id 410d9aad289566dc44d667f2c4af0a36bd31a6546e8d9b32a0bcf3594ef018dd Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:27.221422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07256174ce2a892eccda8c227b08f27a.slice/crio-00099e81abbf9e1a35958c0c321e169f9f842bb093bb9345f9c205ce593d6d3d WatchSource:0}: Error finding container 00099e81abbf9e1a35958c0c321e169f9f842bb093bb9345f9c205ce593d6d3d: Status 404 returned error can't find the container with id 00099e81abbf9e1a35958c0c321e169f9f842bb093bb9345f9c205ce593d6d3d Jul 21 08:54:27.242455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.225406 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 08:54:27.992654 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.986691 2576 apiserver.go:52] "Watching apiserver" Jul 21 08:54:27.992654 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.991677 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 08:54:27.992654 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.992150 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-gnx69","openshift-network-diagnostics/network-check-target-clwbz","openshift-network-operator/iptables-alerter-l5k79","openshift-ovn-kubernetes/ovnkube-node-dkcr7","kube-system/global-pull-secret-syncer-rzw7k","kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79","openshift-cluster-node-tuning-operator/tuned-hkk89","openshift-dns/node-resolver-24cjn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal","openshift-multus/multus-85lxm","openshift-multus/network-metrics-daemon-6r9s8","kube-system/konnectivity-agent-kwrx2","openshift-image-registry/node-ca-lgdbb"] Jul 21 08:54:27.995425 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.994873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:27.998055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.995555 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:27.998055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.996597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 08:54:27.998055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.996895 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hhzzb\"" Jul 21 08:54:27.998055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.997073 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 08:54:27.998055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.997216 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.000689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:27.998445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.000689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.000210 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 08:54:28.000689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.000397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 08:54:28.000689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.000414 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bwjbn\"" Jul 21 08:54:28.000689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.000575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.003335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.005719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qz2xq\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mftcp\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 08:54:28.007205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.006734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 08:54:28.009960 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.007210 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.009960 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.008862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.009960 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.008958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:28.009960 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.009482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 08:54:28.009960 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.009937 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.011629 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.011828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.013440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.013668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.013737 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-czmqq\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.013871 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.014552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.015007 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.016117 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.016225 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4hg9h\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.016450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.017195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.018891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9npm2\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.019137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.019558 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.019824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.019881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.020538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.020662 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.020829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.022745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.024123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.024493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.024759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ncwdx\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.025046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.026524 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.026873 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xk2bp\"" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.027601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.102437 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.027679 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.029555 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-slash\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-sys-fs\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h782r\" (UniqueName: \"kubernetes.io/projected/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-kube-api-access-h782r\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-cnibin\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-kubelet\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-systemd-units\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-netd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-kubelet-config\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-agent-certs\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-konnectivity-ca\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-system-cni-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.106961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7c4n\" (UniqueName: \"kubernetes.io/projected/e73f622b-7eaf-407c-9180-9266216c0b08-kube-api-access-f7c4n\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.035968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-node-log\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-var-lib-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-script-lib\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-serviceca\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86792249-1749-49e4-bd3c-6f255161222e-hosts-file\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86792249-1749-49e4-bd3c-6f255161222e-tmp-dir\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-host-slash\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-systemd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.107928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-log-socket\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-ovn\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-iptables-alerter-script\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmsln\" (UniqueName: \"kubernetes.io/projected/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-kube-api-access-pmsln\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-bin\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-config\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e73f622b-7eaf-407c-9180-9266216c0b08-ovn-node-metrics-cert\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-dbus\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-etc-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-socket-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-registration-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-device-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.110500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zc8h\" (UniqueName: \"kubernetes.io/projected/f3b37665-e17d-48fd-bf5f-7b81824d6894-kube-api-access-8zc8h\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-os-release\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-netns\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-env-overrides\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.036935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.038755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-host\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.038787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2wk\" (UniqueName: \"kubernetes.io/projected/86792249-1749-49e4-bd3c-6f255161222e-kube-api-access-sg2wk\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.038829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxjh\" (UniqueName: \"kubernetes.io/projected/db4a4f92-dcca-4d62-8c70-57127b6db266-kube-api-access-2cxjh\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.046150 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bplcc" Jul 21 08:54:28.111108 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.051180 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bplcc" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.115957 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-system-cni-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-system-cni-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7c4n\" (UniqueName: \"kubernetes.io/projected/e73f622b-7eaf-407c-9180-9266216c0b08-kube-api-access-f7c4n\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-node-log\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-script-lib\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-serviceca\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-sys\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-node-log\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-systemd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.219791 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-systemd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-ovn\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-bin\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-run-ovn\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-config\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-dbus\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-bin\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-kubernetes\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-systemd\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-iptables-alerter-script\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsln\" (UniqueName: \"kubernetes.io/projected/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-kube-api-access-pmsln\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-socket-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-system-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.221976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-multus\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-var-lib-kubelet\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-dbus\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-etc-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-device-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-serviceca\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-hostroot\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139868 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-socket-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-multus-certs\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139884 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-script-lib\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ghz\" (UniqueName: \"kubernetes.io/projected/093f1d45-d527-469b-8889-745344efdda3-kube-api-access-z9ghz\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-lib-modules\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.222660 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.139946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-etc-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-ovnkube-config\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-os-release\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-device-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-netns\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-os-release\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-env-overrides\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-netns\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-modprobe-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2wk\" (UniqueName: \"kubernetes.io/projected/86792249-1749-49e4-bd3c-6f255161222e-kube-api-access-sg2wk\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxjh\" (UniqueName: \"kubernetes.io/projected/db4a4f92-dcca-4d62-8c70-57127b6db266-kube-api-access-2cxjh\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-slash\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.344567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-iptables-alerter-script\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn96g\" (UniqueName: \"kubernetes.io/projected/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-kube-api-access-qn96g\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-slash\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e73f622b-7eaf-407c-9180-9266216c0b08-env-overrides\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-cnibin\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-kubelet\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-cnibin\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-systemd-units\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-systemd-units\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140733 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-kubelet\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-kubelet-config\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-konnectivity-ca\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.346263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-kubelet-config\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-socket-dir-parent\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-conf\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-host\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-bin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-tuned\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.140976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-var-lib-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.141012 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141048 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.141107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:28.641084885 +0000 UTC m=+2.994416088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-run-ovn-kubernetes\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-multus-daemon-config\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.346904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-konnectivity-ca\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86792249-1749-49e4-bd3c-6f255161222e-hosts-file\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86792249-1749-49e4-bd3c-6f255161222e-tmp-dir\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-var-lib-openvswitch\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141427 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86792249-1749-49e4-bd3c-6f255161222e-hosts-file\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-host-slash\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-log-socket\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-host\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4a4f92-dcca-4d62-8c70-57127b6db266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-conf-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-etc-kubernetes\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.348390 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-log-socket\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e73f622b-7eaf-407c-9180-9266216c0b08-ovn-node-metrics-cert\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-registration-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141678 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-host\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-os-release\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141692 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-host-slash\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-cni-binary-copy\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86792249-1749-49e4-bd3c-6f255161222e-tmp-dir\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-registration-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-k8s-cni-cncf-io\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-netns\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zc8h\" (UniqueName: \"kubernetes.io/projected/f3b37665-e17d-48fd-bf5f-7b81824d6894-kube-api-access-8zc8h\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysconfig\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.349064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-tmp\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-cnibin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141899 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.141966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-kubelet\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-run\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqjhp\" (UniqueName: \"kubernetes.io/projected/9e8ecde8-6fc0-4972-ab08-80b400b7c794-kube-api-access-dqjhp\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-sys-fs\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h782r\" (UniqueName: \"kubernetes.io/projected/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-kube-api-access-h782r\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-netd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142187 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3b37665-e17d-48fd-bf5f-7b81824d6894-sys-fs\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-agent-certs\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e73f622b-7eaf-407c-9180-9266216c0b08-host-cni-netd\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.142326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4a4f92-dcca-4d62-8c70-57127b6db266-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.350323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.145899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e73f622b-7eaf-407c-9180-9266216c0b08-ovn-node-metrics-cert\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.147205 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a-agent-certs\") pod \"konnectivity-agent-kwrx2\" (UID: \"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a\") " pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.152169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7c4n\" (UniqueName: \"kubernetes.io/projected/e73f622b-7eaf-407c-9180-9266216c0b08-kube-api-access-f7c4n\") pod \"ovnkube-node-dkcr7\" (UID: \"e73f622b-7eaf-407c-9180-9266216c0b08\") " pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.153204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxjh\" (UniqueName: \"kubernetes.io/projected/db4a4f92-dcca-4d62-8c70-57127b6db266-kube-api-access-2cxjh\") pod \"multus-additional-cni-plugins-gnx69\" (UID: \"db4a4f92-dcca-4d62-8c70-57127b6db266\") " pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.153496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h782r\" (UniqueName: \"kubernetes.io/projected/f2d9e81b-15cc-438f-bf6f-481e73d81bd6-kube-api-access-h782r\") pod \"node-ca-lgdbb\" (UID: \"f2d9e81b-15cc-438f-bf6f-481e73d81bd6\") " pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.154024 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsln\" (UniqueName: \"kubernetes.io/projected/9ff8a342-acd8-4a00-9c85-fc0b76d3198e-kube-api-access-pmsln\") pod \"iptables-alerter-l5k79\" (UID: \"9ff8a342-acd8-4a00-9c85-fc0b76d3198e\") " pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.154346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2wk\" (UniqueName: \"kubernetes.io/projected/86792249-1749-49e4-bd3c-6f255161222e-kube-api-access-sg2wk\") pod \"node-resolver-24cjn\" (UID: \"86792249-1749-49e4-bd3c-6f255161222e\") " pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.154926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zc8h\" (UniqueName: \"kubernetes.io/projected/f3b37665-e17d-48fd-bf5f-7b81824d6894-kube-api-access-8zc8h\") pod \"aws-ebs-csi-driver-node-6qm79\" (UID: \"f3b37665-e17d-48fd-bf5f-7b81824d6894\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.196267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" event={"ID":"07256174ce2a892eccda8c227b08f27a","Type":"ContainerStarted","Data":"00099e81abbf9e1a35958c0c321e169f9f842bb093bb9345f9c205ce593d6d3d"} Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.197889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"b119993a5741f2205909a771ac760fdc","Type":"ContainerStarted","Data":"410d9aad289566dc44d667f2c4af0a36bd31a6546e8d9b32a0bcf3594ef018dd"} Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-multus-daemon-config\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-conf-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-etc-kubernetes\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-os-release\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.351176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-cni-binary-copy\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-k8s-cni-cncf-io\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-netns\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysconfig\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-tmp\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-cnibin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-kubelet\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-run\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqjhp\" (UniqueName: \"kubernetes.io/projected/9e8ecde8-6fc0-4972-ab08-80b400b7c794-kube-api-access-dqjhp\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-sys\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-kubernetes\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-systemd\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-etc-kubernetes\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243844 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysconfig\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.352653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-k8s-cni-cncf-io\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-system-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-system-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243884 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-conf-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-netns\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-os-release\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.243960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-multus\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-multus\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244037 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-multus-daemon-config\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-var-lib-kubelet\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-sys\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-hostroot\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-kubernetes\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-cni-dir\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.354383 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-multus-certs\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-hostroot\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-kubelet\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-cnibin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244236 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-run\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-systemd\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-run-multus-certs\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-var-lib-kubelet\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.244286 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/093f1d45-d527-469b-8889-745344efdda3-cni-binary-copy\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.244350 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:28.744331437 +0000 UTC m=+3.097662652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ghz\" (UniqueName: \"kubernetes.io/projected/093f1d45-d527-469b-8889-745344efdda3-kube-api-access-z9ghz\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-lib-modules\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-modprobe-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn96g\" (UniqueName: \"kubernetes.io/projected/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-kube-api-access-qn96g\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-socket-dir-parent\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-conf\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-host\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-lib-modules\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-bin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-tuned\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244641 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-host\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-host-var-lib-cni-bin\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/093f1d45-d527-469b-8889-745344efdda3-multus-socket-dir-parent\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.244688 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-sysctl-conf\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.246972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-tuned\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.248485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-tmp\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.252969 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.253013 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:28.355783 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.253036 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.253117 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:28.753091565 +0000 UTC m=+3.106422781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.255020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqjhp\" (UniqueName: \"kubernetes.io/projected/9e8ecde8-6fc0-4972-ab08-80b400b7c794-kube-api-access-dqjhp\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.255770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-etc-modprobe-d\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.257743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn96g\" (UniqueName: \"kubernetes.io/projected/bd96e20f-ab6d-48cc-87b6-02e8acc27d07-kube-api-access-qn96g\") pod \"tuned-hkk89\" (UID: \"bd96e20f-ab6d-48cc-87b6-02e8acc27d07\") " pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.259040 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ghz\" (UniqueName: \"kubernetes.io/projected/093f1d45-d527-469b-8889-745344efdda3-kube-api-access-z9ghz\") pod \"multus-85lxm\" (UID: \"093f1d45-d527-469b-8889-745344efdda3\") " pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.316919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.326299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.345966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5k79" Jul 21 08:54:28.356503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.353062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:28.360847 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.360828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lgdbb" Jul 21 08:54:28.366542 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.366520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24cjn" Jul 21 08:54:28.381182 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.381155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnx69" Jul 21 08:54:28.398854 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.398829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkk89" Jul 21 08:54:28.404417 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.404396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85lxm" Jul 21 08:54:28.462531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.462504 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:28.648338 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.648256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:28.648483 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.648375 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:28.648483 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.648458 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:29.648435985 +0000 UTC m=+4.001767208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:28.748834 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.748794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:28.749008 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.748971 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:28.749082 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.749069 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:29.749048047 +0000 UTC m=+4.102379251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:28.849538 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:28.849499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:28.849704 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.849635 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:28.849704 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.849650 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:28.849704 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.849658 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:28.849859 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:28.849713 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:29.849695964 +0000 UTC m=+4.203027164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:29.055014 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.054904 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 08:49:28 +0000 UTC" deadline="2028-01-22 12:08:54.732372247 +0000 UTC" Jul 21 08:54:29.055014 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.054952 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13203h14m25.677423142s" Jul 21 08:54:29.192411 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.192372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:29.192909 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.192529 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:29.260888 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.260843 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d9e81b_15cc_438f_bf6f_481e73d81bd6.slice/crio-84e1f41dcba1bf28aa51f5926147bdfd5c3b5d821d628e4165e7ec1e5a3df803 WatchSource:0}: Error finding container 84e1f41dcba1bf28aa51f5926147bdfd5c3b5d821d628e4165e7ec1e5a3df803: Status 404 returned error can't find the container with id 84e1f41dcba1bf28aa51f5926147bdfd5c3b5d821d628e4165e7ec1e5a3df803 Jul 21 08:54:29.265692 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.265668 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff8a342_acd8_4a00_9c85_fc0b76d3198e.slice/crio-66f115b98b28f6716e9c867fcbd85d117b6825568e9e990d03be82a7502072b5 WatchSource:0}: Error finding container 66f115b98b28f6716e9c867fcbd85d117b6825568e9e990d03be82a7502072b5: Status 404 returned error can't find the container with id 66f115b98b28f6716e9c867fcbd85d117b6825568e9e990d03be82a7502072b5 Jul 21 08:54:29.266814 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.266783 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86792249_1749_49e4_bd3c_6f255161222e.slice/crio-234c9e00c255ca45fd15f3356126cedecea3345ef1bf0b23020fde1492676894 WatchSource:0}: Error finding container 234c9e00c255ca45fd15f3356126cedecea3345ef1bf0b23020fde1492676894: Status 404 returned error can't find the container with id 234c9e00c255ca45fd15f3356126cedecea3345ef1bf0b23020fde1492676894 Jul 21 08:54:29.268355 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.268224 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73f622b_7eaf_407c_9180_9266216c0b08.slice/crio-b160fa26f0d2a93fc09a21835883d56a9dd3da9e1aea5bb71a3e1b4d4f92ba24 WatchSource:0}: Error finding container b160fa26f0d2a93fc09a21835883d56a9dd3da9e1aea5bb71a3e1b4d4f92ba24: Status 404 returned error can't find the container with id b160fa26f0d2a93fc09a21835883d56a9dd3da9e1aea5bb71a3e1b4d4f92ba24 Jul 21 08:54:29.268751 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.268728 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093f1d45_d527_469b_8889_745344efdda3.slice/crio-a86b996ce3b8b7e0a6bc8d2bec5fb08c7c4fbec81650bba04a7edc20254908f8 WatchSource:0}: Error finding container a86b996ce3b8b7e0a6bc8d2bec5fb08c7c4fbec81650bba04a7edc20254908f8: Status 404 returned error can't find the container with id a86b996ce3b8b7e0a6bc8d2bec5fb08c7c4fbec81650bba04a7edc20254908f8 Jul 21 08:54:29.269858 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.269810 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4a4f92_dcca_4d62_8c70_57127b6db266.slice/crio-3f9306c425eac824c37f1e8ed9d6bc431ace3ab766d1574acb18c4da0ee33dad WatchSource:0}: Error finding container 3f9306c425eac824c37f1e8ed9d6bc431ace3ab766d1574acb18c4da0ee33dad: Status 404 returned error can't find the container with id 3f9306c425eac824c37f1e8ed9d6bc431ace3ab766d1574acb18c4da0ee33dad Jul 21 08:54:29.271498 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.271473 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd96e20f_ab6d_48cc_87b6_02e8acc27d07.slice/crio-a71896bb9357fdb88ecf9e7556e1f2064b70631d6b170dba6363009a21d97b0a WatchSource:0}: Error finding container a71896bb9357fdb88ecf9e7556e1f2064b70631d6b170dba6363009a21d97b0a: Status 404 returned error can't find the container with id a71896bb9357fdb88ecf9e7556e1f2064b70631d6b170dba6363009a21d97b0a Jul 21 08:54:29.272553 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.272499 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b37665_e17d_48fd_bf5f_7b81824d6894.slice/crio-42d7ba854b975f2b2d37c8e78214a0649b59d5728acf2963d00253279beb739a WatchSource:0}: Error finding container 42d7ba854b975f2b2d37c8e78214a0649b59d5728acf2963d00253279beb739a: Status 404 returned error can't find the container with id 42d7ba854b975f2b2d37c8e78214a0649b59d5728acf2963d00253279beb739a Jul 21 08:54:29.273879 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:54:29.273858 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70d8e58_33e4_4238_83c8_b9d1f9ec8d4a.slice/crio-67f257ae8a34980386a6bb1458c0c9bf25f1425695330211de5f62f90f2a2791 WatchSource:0}: Error finding container 67f257ae8a34980386a6bb1458c0c9bf25f1425695330211de5f62f90f2a2791: Status 404 returned error can't find the container with id 67f257ae8a34980386a6bb1458c0c9bf25f1425695330211de5f62f90f2a2791 Jul 21 08:54:29.518331 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.518150 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:29.655327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.655217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:29.655467 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.655360 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:29.655467 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.655417 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:31.65540481 +0000 UTC m=+6.008736014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:29.756458 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.756419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:29.756647 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.756578 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:29.756705 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.756654 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:31.756632521 +0000 UTC m=+6.109963741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:29.857679 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:29.857641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:29.857843 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.857820 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:29.857843 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.857843 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:29.857961 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.857855 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:29.858057 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:29.857965 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:31.85794562 +0000 UTC m=+6.211276833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:30.055382 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.055294 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 08:49:28 +0000 UTC" deadline="2028-02-28 19:17:57.20241042 +0000 UTC" Jul 21 08:54:30.055382 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.055337 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14098h23m27.147078088s" Jul 21 08:54:30.193866 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.193669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:30.193866 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:30.193786 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:30.194495 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.194180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:30.194495 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:30.194277 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:30.214291 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.214206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5k79" event={"ID":"9ff8a342-acd8-4a00-9c85-fc0b76d3198e","Type":"ContainerStarted","Data":"66f115b98b28f6716e9c867fcbd85d117b6825568e9e990d03be82a7502072b5"} Jul 21 08:54:30.217141 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.217110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lgdbb" event={"ID":"f2d9e81b-15cc-438f-bf6f-481e73d81bd6","Type":"ContainerStarted","Data":"84e1f41dcba1bf28aa51f5926147bdfd5c3b5d821d628e4165e7ec1e5a3df803"} Jul 21 08:54:30.225197 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.225165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" event={"ID":"07256174ce2a892eccda8c227b08f27a","Type":"ContainerStarted","Data":"31782f180c8a28eb89397e0d8aca7e64fca16716fca3901278ab0d6c7e582a1c"} Jul 21 08:54:30.242743 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.242609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwrx2" event={"ID":"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a","Type":"ContainerStarted","Data":"67f257ae8a34980386a6bb1458c0c9bf25f1425695330211de5f62f90f2a2791"} Jul 21 08:54:30.252904 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.252778 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" podStartSLOduration=3.252757762 podStartE2EDuration="3.252757762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:30.251937814 +0000 UTC m=+4.605269061" watchObservedRunningTime="2026-07-21 08:54:30.252757762 +0000 UTC m=+4.606088985" Jul 21 08:54:30.261170 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.261136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85lxm" event={"ID":"093f1d45-d527-469b-8889-745344efdda3","Type":"ContainerStarted","Data":"a86b996ce3b8b7e0a6bc8d2bec5fb08c7c4fbec81650bba04a7edc20254908f8"} Jul 21 08:54:30.269586 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.268719 2576 generic.go:356] "Generic (PLEG): container finished" podID="b119993a5741f2205909a771ac760fdc" containerID="48d0dc4c8e20b7581aab61914cb5914b8a913ce64738a54d615c42a6b9872e3a" exitCode=0 Jul 21 08:54:30.269586 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.268801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"b119993a5741f2205909a771ac760fdc","Type":"ContainerDied","Data":"48d0dc4c8e20b7581aab61914cb5914b8a913ce64738a54d615c42a6b9872e3a"} Jul 21 08:54:30.278677 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.278649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" event={"ID":"f3b37665-e17d-48fd-bf5f-7b81824d6894","Type":"ContainerStarted","Data":"42d7ba854b975f2b2d37c8e78214a0649b59d5728acf2963d00253279beb739a"} Jul 21 08:54:30.281962 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.281936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkk89" event={"ID":"bd96e20f-ab6d-48cc-87b6-02e8acc27d07","Type":"ContainerStarted","Data":"a71896bb9357fdb88ecf9e7556e1f2064b70631d6b170dba6363009a21d97b0a"} Jul 21 08:54:30.286575 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.286546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerStarted","Data":"3f9306c425eac824c37f1e8ed9d6bc431ace3ab766d1574acb18c4da0ee33dad"} Jul 21 08:54:30.295300 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.295271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"b160fa26f0d2a93fc09a21835883d56a9dd3da9e1aea5bb71a3e1b4d4f92ba24"} Jul 21 08:54:30.306375 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:30.306254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24cjn" event={"ID":"86792249-1749-49e4-bd3c-6f255161222e","Type":"ContainerStarted","Data":"234c9e00c255ca45fd15f3356126cedecea3345ef1bf0b23020fde1492676894"} Jul 21 08:54:31.192049 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:31.192014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:31.192235 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.192162 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:31.337063 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:31.337024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"b119993a5741f2205909a771ac760fdc","Type":"ContainerStarted","Data":"c4974ab6f8d01cdaea3b355e203bb71bed0f992ebf53bc0c8e25552e615d044c"} Jul 21 08:54:31.676861 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:31.676772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:31.677044 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.676927 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:31.677044 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.677009 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:35.676973493 +0000 UTC m=+10.030304711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:31.778554 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:31.777823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:31.778554 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.778047 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:31.778554 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.778143 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:35.778119144 +0000 UTC m=+10.131450359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:31.879362 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:31.878647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:31.879362 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.878833 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:31.879362 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.878855 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:31.879362 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.878867 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:31.879362 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:31.878924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:35.878907165 +0000 UTC m=+10.232238383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:32.193126 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:32.193096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:32.193290 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:32.193235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:32.193641 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:32.193619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:32.193743 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:32.193719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:33.192010 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:33.191933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:33.192501 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:33.192097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:34.192198 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:34.192079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:34.192664 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:34.192337 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:34.192664 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:34.192521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:34.192664 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:34.192653 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:35.192558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:35.192523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:35.193038 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.192697 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:35.716640 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:35.716111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:35.716640 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.716248 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:35.716640 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.716304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:43.71628743 +0000 UTC m=+18.069618648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:35.816818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:35.816773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:35.817235 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.817117 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:35.817235 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.817199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:43.817178531 +0000 UTC m=+18.170509730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:35.917304 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:35.917265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:35.917486 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.917454 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:35.917486 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.917480 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:35.917612 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.917493 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:35.917612 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:35.917558 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:43.917539367 +0000 UTC m=+18.270870580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:36.193590 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:36.192969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:36.193590 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:36.193098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:36.193590 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:36.193442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:36.193590 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:36.193542 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:37.191915 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:37.191879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:37.192096 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:37.192043 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:38.192778 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:38.192747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:38.193235 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:38.192882 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:38.193342 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:38.193325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:38.193444 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:38.193425 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:39.192090 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:39.192055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:39.192253 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:39.192187 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:40.192216 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:40.192176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:40.192629 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:40.192318 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:40.192629 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:40.192373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:40.192629 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:40.192518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:41.192373 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:41.192340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:41.192807 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:41.192515 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:42.191708 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:42.191678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:42.191872 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:42.191678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:42.191872 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:42.191812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:42.191967 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:42.191917 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:43.192199 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:43.192157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:43.192697 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.192308 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:43.777507 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:43.777471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:43.777652 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.777616 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:43.777687 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.777681 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:54:59.777664024 +0000 UTC m=+34.130995244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:43.878229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:43.878198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:43.878396 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.878344 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:43.878521 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.878406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:59.878387861 +0000 UTC m=+34.231719064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:43.979339 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:43.979308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:43.979507 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.979471 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:43.979507 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.979489 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:43.979507 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.979502 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:43.979686 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:43.979567 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:59.979548724 +0000 UTC m=+34.332879933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:44.191696 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:44.191661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:44.191880 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:44.191661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:44.191880 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:44.191787 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:44.192003 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:44.191887 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:45.191650 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:45.191614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:45.192178 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:45.191759 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:46.192699 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:46.192668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:46.193110 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:46.192757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:46.193110 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:46.192759 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:46.193110 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:46.192868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:47.191710 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:47.191679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:47.191892 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:47.191798 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:48.191607 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.191575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:48.192047 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:48.191682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:48.192047 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.191745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:48.192047 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:48.191865 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:48.390127 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.389075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkk89" event={"ID":"bd96e20f-ab6d-48cc-87b6-02e8acc27d07","Type":"ContainerStarted","Data":"4cea513133c246439413d8949a950a960541367e78fc39f05b5bbfa5aacc8535"} Jul 21 08:54:48.401473 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.401215 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" podStartSLOduration=21.401193747 podStartE2EDuration="21.401193747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.351869726 +0000 UTC m=+5.705200949" watchObservedRunningTime="2026-07-21 08:54:48.401193747 +0000 UTC m=+22.754524970" Jul 21 08:54:48.401553 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.401456 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kwrx2" podStartSLOduration=3.471611042 podStartE2EDuration="22.401444771s" totalImagesPullingTime="18.929833729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:48.397927247 +0000 UTC m=+22.751258474" watchObservedRunningTime="2026-07-21 08:54:48.401444771 +0000 UTC m=+22.754775995" Jul 21 08:54:48.415538 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.415419 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hkk89" podStartSLOduration=3.459384741 podStartE2EDuration="22.415391824s" totalImagesPullingTime="18.956007083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:48.414813486 +0000 UTC m=+22.768144708" watchObservedRunningTime="2026-07-21 08:54:48.415391824 +0000 UTC m=+22.768723048" Jul 21 08:54:48.431775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.431716 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-85lxm" podStartSLOduration=3.422407492 podStartE2EDuration="22.431693742s" totalImagesPullingTime="19.00928625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:48.430673691 +0000 UTC m=+22.784004915" watchObservedRunningTime="2026-07-21 08:54:48.431693742 +0000 UTC m=+22.785024966" Jul 21 08:54:48.582677 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.582508 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:48.651357 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:48.651280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:49.191824 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.191788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:49.192512 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:49.191900 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:49.392238 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.392204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" event={"ID":"f3b37665-e17d-48fd-bf5f-7b81824d6894","Type":"ContainerStarted","Data":"6fadfeedb3c62521ccbaf9cbee5f09ffbd97dcc8ca9673910e7682f3c7b8ef21"} Jul 21 08:54:49.393731 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.393706 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="2904416ba44985ba9da029f1f14112d176e8c32d253741883df822c9f4394b7d" exitCode=0 Jul 21 08:54:49.393806 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.393786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"2904416ba44985ba9da029f1f14112d176e8c32d253741883df822c9f4394b7d"} Jul 21 08:54:49.396882 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.396853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"417d183eadc5c0a470cf955d153634fdff4161452c87a1716bc308dac3cb9351"} Jul 21 08:54:49.397006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.396940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"15f021b31b022f767c475f0d223dedd90ca535b16f3c69059e4fe22a6da7d0fd"} Jul 21 08:54:49.397079 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.397014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"056e5afb60a5bf431d0d5a68f3bd28189c65e48908050ae0c142ec6477f9f69f"} Jul 21 08:54:49.397079 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.397062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"de352c1c2e6fcdea3ccf5359e59c707e26e3f93af40759ceab2c773ac827c357"} Jul 21 08:54:49.397184 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.397104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"b96fd2b36b04667b720c795c231ab721ddbf226762fca9fc4179e9d0657f6fd8"} Jul 21 08:54:49.397184 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.397148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"f6e85e6da6854ee47dcc9ebe2ff30e9984f11cac489b9704c4b76e6ce94cefc7"} Jul 21 08:54:49.398309 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.398283 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24cjn" event={"ID":"86792249-1749-49e4-bd3c-6f255161222e","Type":"ContainerStarted","Data":"cef4a775b6b6c5f291c78959814425c87ff8f7df226f9cbf9fda765e8fbfdc0b"} Jul 21 08:54:49.399633 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.399610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lgdbb" event={"ID":"f2d9e81b-15cc-438f-bf6f-481e73d81bd6","Type":"ContainerStarted","Data":"ee1a64bfc0b4942a32ec22e3ce1d664de6a2368a4b36a18177d8c784db033eb0"} Jul 21 08:54:49.401296 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.401273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwrx2" event={"ID":"f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a","Type":"ContainerStarted","Data":"226d58a19b638d66eb95a0c09cd23dc0e0d3eb59fc4d7e24d1923b24fb14fefe"} Jul 21 08:54:49.402482 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.402457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85lxm" event={"ID":"093f1d45-d527-469b-8889-745344efdda3","Type":"ContainerStarted","Data":"6d58d20fab08f054e8b35a0cc6850812618c86aa6ec82ee9829473fd761d8998"} Jul 21 08:54:49.438712 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.438673 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-24cjn" podStartSLOduration=4.481454623 podStartE2EDuration="23.438657372s" totalImagesPullingTime="18.957202749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:49.426785477 +0000 UTC m=+23.780116701" watchObservedRunningTime="2026-07-21 08:54:49.438657372 +0000 UTC m=+23.791988595" Jul 21 08:54:49.438911 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.438885 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lgdbb" podStartSLOduration=8.902917726 podStartE2EDuration="23.438879883s" totalImagesPullingTime="14.535962157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:49.438760815 +0000 UTC m=+23.792092037" watchObservedRunningTime="2026-07-21 08:54:49.438879883 +0000 UTC m=+23.792211117" Jul 21 08:54:49.498632 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.498578 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:49.556259 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.556237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:49.778107 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:49.778083 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 08:54:50.091368 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.091278 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T08:54:49.778100281Z","UUID":"88712cba-e4ca-4417-8941-7512cb7a3f0a","Handler":null,"Name":"","Endpoint":""} Jul 21 08:54:50.092842 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.092824 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 08:54:50.092971 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.092863 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 08:54:50.191565 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.191526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:50.191565 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.191544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:50.191792 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:50.191655 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:50.191792 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:50.191733 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:50.410800 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.410710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" event={"ID":"f3b37665-e17d-48fd-bf5f-7b81824d6894","Type":"ContainerStarted","Data":"12cbb933f42c3aa04ce03cdad2952bc69182c8a3ec688bf8546c9e86a77cca8c"} Jul 21 08:54:50.412412 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.412356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5k79" event={"ID":"9ff8a342-acd8-4a00-9c85-fc0b76d3198e","Type":"ContainerStarted","Data":"5fee2d5f65614b54048f03a49c7c07381f84525e0f0868885e51eb04c9d5c57b"} Jul 21 08:54:50.426008 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.425948 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l5k79" podStartSLOduration=5.468210843 podStartE2EDuration="24.425933995s" totalImagesPullingTime="18.957723152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:50.425684447 +0000 UTC m=+24.779015670" watchObservedRunningTime="2026-07-21 08:54:50.425933995 +0000 UTC m=+24.779265216" Jul 21 08:54:50.543831 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.543791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:50.601759 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.601726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:50.751679 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.751593 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:50.852462 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.852422 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:50.970635 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:50.970600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:51.027083 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.027001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:51.191453 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.191423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:51.191641 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:51.191566 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:51.402228 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.402202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:51.402816 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.402789 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:51.417790 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.417613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" event={"ID":"f3b37665-e17d-48fd-bf5f-7b81824d6894","Type":"ContainerStarted","Data":"a2ce1f128d11be4c3efa9aac9270a5b87cee20afe2fdbd9412fec63f614f39af"} Jul 21 08:54:51.421327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.421245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"50ced9525abbe1e92491f82bfb1777f67035deb57e0c019d4aacb7be6ad4d549"} Jul 21 08:54:51.432415 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.432375 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qm79" podStartSLOduration=3.792822209 podStartE2EDuration="25.432361459s" totalImagesPullingTime="21.63953925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:51.431787301 +0000 UTC m=+25.785118523" watchObservedRunningTime="2026-07-21 08:54:51.432361459 +0000 UTC m=+25.785692680" Jul 21 08:54:51.789595 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.789567 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:51.790153 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.790133 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kwrx2" Jul 21 08:54:51.853767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:51.853737 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:52.192456 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:52.192207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:52.192636 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:52.192254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:52.192636 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:52.192562 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:52.192636 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:52.192621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:52.841316 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:52.841281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:52.924884 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:52.924853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:52.988948 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:52.988908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:53.192461 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:53.192375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:53.192621 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:53.192500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:53.226928 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:53.226897 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:53.309044 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:53.309000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:53.510305 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:53.510139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:53.610241 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:53.610079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:54.124613 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.124573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:54.192009 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.191951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:54.192164 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:54.192099 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:54.192164 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.192144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:54.192309 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:54.192226 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:54.225712 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.225677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:54.428966 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.428934 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="4825542d4832669172868891bfbd7380043141ebffc9bbaff341a24d13402010" exitCode=0 Jul 21 08:54:54.429172 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.429019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"4825542d4832669172868891bfbd7380043141ebffc9bbaff341a24d13402010"} Jul 21 08:54:54.432880 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.432858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" event={"ID":"e73f622b-7eaf-407c-9180-9266216c0b08","Type":"ContainerStarted","Data":"43acc85381b4795bc813cdc955595e68a82568ef5f3ffb73b7609e021d09a9e4"} Jul 21 08:54:54.433144 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.433129 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:54.447913 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.447894 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:54.474944 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:54.474903 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" podStartSLOduration=9.45943223 podStartE2EDuration="28.474886561s" totalImagesPullingTime="19.015454331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:54.474668614 +0000 UTC m=+28.827999846" watchObservedRunningTime="2026-07-21 08:54:54.474886561 +0000 UTC m=+28.828217784" Jul 21 08:54:55.191707 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.191679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:55.192121 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:55.191798 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:55.376691 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.376665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24cjn_86792249-1749-49e4-bd3c-6f255161222e/dns-node-resolver/0.log" Jul 21 08:54:55.434634 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.434605 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:55.434736 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.434685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:55.453060 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.453038 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:54:55.620961 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.620918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6r9s8"] Jul 21 08:54:55.621150 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.621127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:55.621284 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:55.621256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:55.621626 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.621605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clwbz"] Jul 21 08:54:55.621705 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.621686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:55.621767 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:55.621751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:55.631864 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.631842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzw7k"] Jul 21 08:54:55.631974 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.631937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:55.632046 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:55.632017 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:55.708467 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.708377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:55.766823 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:55.766790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:56.438798 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:56.438549 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="cd53f3a2ea4d1bd2ff24902247791cdb4572a9c35137f24a0000c815f8ab7d55" exitCode=0 Jul 21 08:54:56.438798 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:56.438623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"cd53f3a2ea4d1bd2ff24902247791cdb4572a9c35137f24a0000c815f8ab7d55"} Jul 21 08:54:56.577869 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:56.577844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lgdbb_f2d9e81b-15cc-438f-bf6f-481e73d81bd6/node-ca/0.log" Jul 21 08:54:56.771599 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:56.771523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:57.192243 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:57.192210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:57.192409 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:57.192323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:57.192409 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:57.192330 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:57.192500 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:57.192407 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:57.192500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:57.192414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:57.192562 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:57.192507 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:58.448056 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:58.447960 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="e3e82b39ad72dd6b77b3b499e472bfdeeb4173a9fe1f2aa860e50d8a08fd0bdd" exitCode=0 Jul 21 08:54:58.448056 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:58.448031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"e3e82b39ad72dd6b77b3b499e472bfdeeb4173a9fe1f2aa860e50d8a08fd0bdd"} Jul 21 08:54:58.453321 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:58.453289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:58.835803 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:58.835773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.087804 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.087721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.142271 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.142226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.191431 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.191399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:59.191431 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.191420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:59.191431 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.191434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:59.191687 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.191534 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:54:59.191687 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.191594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:54:59.191687 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.191656 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:54:59.630731 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.630633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.793563 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.793527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:54:59.793747 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.793694 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:59.793879 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.793772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret podName:a5e94215-cf73-44e4-94fa-9f7e2ea1156b nodeName:}" failed. No retries permitted until 2026-07-21 08:55:31.793751753 +0000 UTC m=+66.147082966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret") pod "global-pull-secret-syncer-rzw7k" (UID: "a5e94215-cf73-44e4-94fa-9f7e2ea1156b") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:59.845469 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.845440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.894585 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.894503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:54:59.894736 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.894662 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:59.894796 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.894738 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs podName:9e8ecde8-6fc0-4972-ab08-80b400b7c794 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:31.89472027 +0000 UTC m=+66.248051472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs") pod "network-metrics-daemon-6r9s8" (UID: "9e8ecde8-6fc0-4972-ab08-80b400b7c794") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:59.945855 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.945824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:54:59.995260 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:54:59.995225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:54:59.995435 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.995404 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:59.995435 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.995432 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:59.995543 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.995444 2576 projected.go:196] Error preparing data for projected volume kube-api-access-cdp9r for pod openshift-network-diagnostics/network-check-target-clwbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:59.995543 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:54:59.995501 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r podName:edac258e-34fe-4970-9ad6-4d5ac958a4e5 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:31.995484651 +0000 UTC m=+66.348815864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdp9r" (UniqueName: "kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r") pod "network-check-target-clwbz" (UID: "edac258e-34fe-4970-9ad6-4d5ac958a4e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:55:00.046883 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:00.046847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:00.147778 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:00.147681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:00.333724 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:00.333695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:01.192310 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:01.192273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:01.192870 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:01.192273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:01.192870 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:01.192393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:01.192870 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:01.192274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:01.192870 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:01.192473 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:01.192870 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:01.192575 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:01.525236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:01.525149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:01.725336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:01.725304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:02.030134 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:02.030103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:02.131353 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:02.131318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:02.323003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:02.322956 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:03.192351 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.192316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:03.192555 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.192316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:03.192555 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:03.192424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:03.192555 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:03.192520 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:03.192555 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.192320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:03.192778 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:03.192636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:03.320263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.320228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:03.461682 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.461599 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="8945a299ff094c6c5d7cb629863d79407480a7669329c4e6bebbd913066505e3" exitCode=0 Jul 21 08:55:03.461682 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.461648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"8945a299ff094c6c5d7cb629863d79407480a7669329c4e6bebbd913066505e3"} Jul 21 08:55:03.525427 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.525404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:03.625736 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.625708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:03.725438 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.725348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:03.920331 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:03.920302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:04.119260 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:04.119230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:04.318732 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:04.318703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:04.369792 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:04.369710 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:04.466336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:04.466306 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4a4f92-dcca-4d62-8c70-57127b6db266" containerID="5540384970dfa938c22094a7c5fa04e483bb6b200ec9a199896f63543944e2f9" exitCode=0 Jul 21 08:55:04.466805 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:04.466360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerDied","Data":"5540384970dfa938c22094a7c5fa04e483bb6b200ec9a199896f63543944e2f9"} Jul 21 08:55:05.192191 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.192007 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:05.192358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.192022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:05.192358 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:05.192273 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:05.192358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.192054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:05.192358 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:05.192326 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:05.192568 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:05.192404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:05.326840 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.326806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:05.422937 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.422909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:05.471777 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.471730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnx69" event={"ID":"db4a4f92-dcca-4d62-8c70-57127b6db266","Type":"ContainerStarted","Data":"6585c9c423a1885d37f054d4f51731a16d6a486a2d7d8a24591196609c1e4d37"} Jul 21 08:55:05.491868 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.491825 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gnx69" podStartSLOduration=9.739969182 podStartE2EDuration="39.491808561s" totalImagesPullingTime="29.751839379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:05.491147841 +0000 UTC m=+39.844479065" watchObservedRunningTime="2026-07-21 08:55:05.491808561 +0000 UTC m=+39.845139788" Jul 21 08:55:05.726118 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.726026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:05.828406 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.828374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:05.929205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:05.929172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:06.121863 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:06.121826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:06.320016 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:06.319969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:07.192059 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.192031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:07.192059 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.192058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:07.192467 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.192058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:07.192467 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:07.192127 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:07.192467 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:07.192210 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:07.192467 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:07.192260 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:07.323505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.323472 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:07.523618 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.523538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:07.924859 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:07.924830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:08.125594 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:08.125559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:08.519513 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:08.519478 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:08.575239 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:08.575205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:09.191722 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.191690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:09.191873 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.191731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:09.191873 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.191688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:09.191873 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:09.191802 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:09.191873 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:09.191851 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:09.192060 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:09.191911 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:09.374591 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.374561 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:09.517584 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.517510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:09.956953 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:09.956917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:10.132090 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:10.132063 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:10.329101 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:10.329067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:11.191478 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:11.191448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:11.192040 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:11.191486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:11.192040 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:11.191549 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:11.192040 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:11.191599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:11.192040 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:11.191723 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:11.192040 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:11.191754 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:13.192376 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:13.192341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:13.192813 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:13.192341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:13.192813 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:13.192456 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:13.192813 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:13.192341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:13.192813 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:13.192545 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:13.192813 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:13.192640 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:15.192203 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:15.192168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:15.192203 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:15.192204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:15.192644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:15.192168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:15.192644 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:15.192291 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6r9s8" podUID="9e8ecde8-6fc0-4972-ab08-80b400b7c794" Jul 21 08:55:15.192644 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:15.192350 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzw7k" podUID="a5e94215-cf73-44e4-94fa-9f7e2ea1156b" Jul 21 08:55:15.192644 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:15.192418 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clwbz" podUID="edac258e-34fe-4970-9ad6-4d5ac958a4e5" Jul 21 08:55:16.454156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:16.454124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:16.626273 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:16.626242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:16.726970 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:16.726942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:16.980218 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:16.980133 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeReady" Jul 21 08:55:16.980358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:16.980268 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 08:55:17.026201 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.026170 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbdxv"] Jul 21 08:55:17.051036 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.051004 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9pd"] Jul 21 08:55:17.051173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.051081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.053203 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.053164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 08:55:17.053203 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.053165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wps88\"" Jul 21 08:55:17.053408 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.053227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 08:55:17.053408 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.053229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 08:55:17.053527 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.053511 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 08:55:17.075310 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.075281 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbdxv"] Jul 21 08:55:17.075433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.075327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9pd"] Jul 21 08:55:17.075433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.075399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.077333 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.077317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 08:55:17.077528 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.077514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pjg49\"" Jul 21 08:55:17.077676 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.077659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 08:55:17.077921 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.077901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 08:55:17.122000 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.121961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a787559b-1dcd-4df3-b3b7-8be95dd15210-data-volume\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.122138 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sn4g\" (UniqueName: \"kubernetes.io/projected/33fbe434-8225-4bb5-81f2-8f1eec91fc40-kube-api-access-4sn4g\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.122138 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fbe434-8225-4bb5-81f2-8f1eec91fc40-cert\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.122138 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a787559b-1dcd-4df3-b3b7-8be95dd15210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.122138 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wnx\" (UniqueName: \"kubernetes.io/projected/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-api-access-n9wnx\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.122266 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.122266 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.122176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a787559b-1dcd-4df3-b3b7-8be95dd15210-crio-socket\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.124110 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.124082 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vhgd"] Jul 21 08:55:17.139183 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.139154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vhgd"] Jul 21 08:55:17.139312 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.139271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.141036 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.141014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdqrz\"" Jul 21 08:55:17.141192 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.141048 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 08:55:17.141508 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.141494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 08:55:17.192028 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.191975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:17.192243 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.192038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:17.192243 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.192044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:17.194369 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.194346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 08:55:17.194869 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.194840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 08:55:17.195094 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.195080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 08:55:17.195188 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.195155 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bsz6x\"" Jul 21 08:55:17.195188 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.195162 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 08:55:17.195518 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.195489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hlcjd\"" Jul 21 08:55:17.222457 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.222546 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a787559b-1dcd-4df3-b3b7-8be95dd15210-crio-socket\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.222546 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-config-volume\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.222649 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a787559b-1dcd-4df3-b3b7-8be95dd15210-data-volume\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.222649 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a787559b-1dcd-4df3-b3b7-8be95dd15210-crio-socket\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.222752 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sn4g\" (UniqueName: \"kubernetes.io/projected/33fbe434-8225-4bb5-81f2-8f1eec91fc40-kube-api-access-4sn4g\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.222752 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fbe434-8225-4bb5-81f2-8f1eec91fc40-cert\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.222752 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-metrics-tls\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.222889 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblms\" (UniqueName: \"kubernetes.io/projected/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-kube-api-access-vblms\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.222889 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.222870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a787559b-1dcd-4df3-b3b7-8be95dd15210-data-volume\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.223035 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.223007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a787559b-1dcd-4df3-b3b7-8be95dd15210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.223141 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.223038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wnx\" (UniqueName: \"kubernetes.io/projected/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-api-access-n9wnx\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.223141 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.223058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-tmp-dir\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.223141 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.223124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.223268 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.223142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:17.226680 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.226661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fbe434-8225-4bb5-81f2-8f1eec91fc40-cert\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.226680 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.226670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a787559b-1dcd-4df3-b3b7-8be95dd15210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.229328 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.229308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sn4g\" (UniqueName: \"kubernetes.io/projected/33fbe434-8225-4bb5-81f2-8f1eec91fc40-kube-api-access-4sn4g\") pod \"ingress-canary-gs9pd\" (UID: \"33fbe434-8225-4bb5-81f2-8f1eec91fc40\") " pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.229328 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.229320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wnx\" (UniqueName: \"kubernetes.io/projected/a787559b-1dcd-4df3-b3b7-8be95dd15210-kube-api-access-n9wnx\") pod \"insights-runtime-extractor-pbdxv\" (UID: \"a787559b-1dcd-4df3-b3b7-8be95dd15210\") " pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.274737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.274655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:17.323947 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.323917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-config-volume\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.324066 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.324005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-metrics-tls\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.324066 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.324027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblms\" (UniqueName: \"kubernetes.io/projected/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-kube-api-access-vblms\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.324066 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.324049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-tmp-dir\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.324405 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.324382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-tmp-dir\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.324523 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.324501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-config-volume\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.326360 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.326340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-metrics-tls\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.331490 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.331460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblms\" (UniqueName: \"kubernetes.io/projected/29d688b7-4dfc-42b7-ab3c-fff35929c8d9-kube-api-access-vblms\") pod \"dns-default-8vhgd\" (UID: \"29d688b7-4dfc-42b7-ab3c-fff35929c8d9\") " pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.359994 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.359956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbdxv" Jul 21 08:55:17.383038 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.383015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs9pd" Jul 21 08:55:17.448947 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.448891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:17.566159 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.566124 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs9pd"] Jul 21 08:55:17.569287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.569263 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbdxv"] Jul 21 08:55:17.570183 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:17.570158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fbe434_8225_4bb5_81f2_8f1eec91fc40.slice/crio-724aefd0bbd78dc22a45205a4f07723aa4a41e22b38537f0f4adfab7f91204ae WatchSource:0}: Error finding container 724aefd0bbd78dc22a45205a4f07723aa4a41e22b38537f0f4adfab7f91204ae: Status 404 returned error can't find the container with id 724aefd0bbd78dc22a45205a4f07723aa4a41e22b38537f0f4adfab7f91204ae Jul 21 08:55:17.573283 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:17.573259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda787559b_1dcd_4df3_b3b7_8be95dd15210.slice/crio-436408d9b76d9e2a25d18fe1f8e0ec1a3b0f5cbc3ed7b722f2f8d13c79b8517b WatchSource:0}: Error finding container 436408d9b76d9e2a25d18fe1f8e0ec1a3b0f5cbc3ed7b722f2f8d13c79b8517b: Status 404 returned error can't find the container with id 436408d9b76d9e2a25d18fe1f8e0ec1a3b0f5cbc3ed7b722f2f8d13c79b8517b Jul 21 08:55:17.605905 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:17.605845 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vhgd"] Jul 21 08:55:17.609072 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:17.609046 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d688b7_4dfc_42b7_ab3c_fff35929c8d9.slice/crio-5a3177cfc25cf7256bc71ff906aa38e278aab51946b468c3ef0a8a41ab686b8c WatchSource:0}: Error finding container 5a3177cfc25cf7256bc71ff906aa38e278aab51946b468c3ef0a8a41ab686b8c: Status 404 returned error can't find the container with id 5a3177cfc25cf7256bc71ff906aa38e278aab51946b468c3ef0a8a41ab686b8c Jul 21 08:55:18.504730 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:18.504682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vhgd" event={"ID":"29d688b7-4dfc-42b7-ab3c-fff35929c8d9","Type":"ContainerStarted","Data":"5a3177cfc25cf7256bc71ff906aa38e278aab51946b468c3ef0a8a41ab686b8c"} Jul 21 08:55:18.506884 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:18.506810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs9pd" event={"ID":"33fbe434-8225-4bb5-81f2-8f1eec91fc40","Type":"ContainerStarted","Data":"724aefd0bbd78dc22a45205a4f07723aa4a41e22b38537f0f4adfab7f91204ae"} Jul 21 08:55:18.508372 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:18.508347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbdxv" event={"ID":"a787559b-1dcd-4df3-b3b7-8be95dd15210","Type":"ContainerStarted","Data":"436408d9b76d9e2a25d18fe1f8e0ec1a3b0f5cbc3ed7b722f2f8d13c79b8517b"} Jul 21 08:55:24.527818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.527772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vhgd" event={"ID":"29d688b7-4dfc-42b7-ab3c-fff35929c8d9","Type":"ContainerStarted","Data":"1365c20bdc3a903e748ab8f3623d49ab17ea840370d957e942a1143b58cf491c"} Jul 21 08:55:24.528329 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.527850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vhgd" event={"ID":"29d688b7-4dfc-42b7-ab3c-fff35929c8d9","Type":"ContainerStarted","Data":"f56783e91e6a7a14cbdc227139b75b59af0e43636d92146328c736be224fbbaf"} Jul 21 08:55:24.528329 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.527896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:24.529543 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.529515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs9pd" event={"ID":"33fbe434-8225-4bb5-81f2-8f1eec91fc40","Type":"ContainerStarted","Data":"4d4661f7b6b94ab2a492475c7daa37705707e606a0ca6636abff93ab670df329"} Jul 21 08:55:24.531931 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.531909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbdxv" event={"ID":"a787559b-1dcd-4df3-b3b7-8be95dd15210","Type":"ContainerStarted","Data":"92cffc3dd1817274f310367ad85b8930f6ed529c9bdbdbd0113178ec7ca54c62"} Jul 21 08:55:24.543008 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.542937 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8vhgd" podStartSLOduration=1.478202305 podStartE2EDuration="7.542921121s" totalImagesPullingTime="6.064718816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.542423762 +0000 UTC m=+58.895754988" watchObservedRunningTime="2026-07-21 08:55:24.542921121 +0000 UTC m=+58.896252346" Jul 21 08:55:24.548112 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.548078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.562525 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.562469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gs9pd" podStartSLOduration=1.459842433 podStartE2EDuration="7.562446579s" totalImagesPullingTime="6.102604146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.561910439 +0000 UTC m=+58.915241661" watchObservedRunningTime="2026-07-21 08:55:24.562446579 +0000 UTC m=+58.915777803" Jul 21 08:55:24.659607 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.659575 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.677366 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.677335 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb"] Jul 21 08:55:24.679481 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.679455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:24.681179 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.681153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 08:55:24.681313 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.681165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2rksr\"" Jul 21 08:55:24.689774 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.689747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb"] Jul 21 08:55:24.726278 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.726217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.776190 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.775515 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-2zcp8"] Jul 21 08:55:24.777590 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.777562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:24.779964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.779519 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 08:55:24.779964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.779679 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-22wjt\"" Jul 21 08:55:24.779964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.779767 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 08:55:24.783135 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.783057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-htnwb\" (UID: \"6e3bd050-c823-4e5f-abab-2842218be495\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:24.787828 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.787373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-2zcp8"] Jul 21 08:55:24.801284 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.801223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.884455 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.884411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxnl\" (UniqueName: \"kubernetes.io/projected/3f94ae41-fbf0-4683-a7cc-0efcedaa33c9-kube-api-access-sjxnl\") pod \"downloads-5bc67dcd46-2zcp8\" (UID: \"3f94ae41-fbf0-4683-a7cc-0efcedaa33c9\") " pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:24.884650 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.884507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-htnwb\" (UID: \"6e3bd050-c823-4e5f-abab-2842218be495\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:24.884650 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:24.884638 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 08:55:24.884767 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:24.884698 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates podName:6e3bd050-c823-4e5f-abab-2842218be495 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:25.384680335 +0000 UTC m=+59.738011549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-htnwb" (UID: "6e3bd050-c823-4e5f-abab-2842218be495") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 08:55:24.933150 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.933113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.985614 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.985581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxnl\" (UniqueName: \"kubernetes.io/projected/3f94ae41-fbf0-4683-a7cc-0efcedaa33c9-kube-api-access-sjxnl\") pod \"downloads-5bc67dcd46-2zcp8\" (UID: \"3f94ae41-fbf0-4683-a7cc-0efcedaa33c9\") " pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:24.991207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.991169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:24.993519 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:24.993499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxnl\" (UniqueName: \"kubernetes.io/projected/3f94ae41-fbf0-4683-a7cc-0efcedaa33c9-kube-api-access-sjxnl\") pod \"downloads-5bc67dcd46-2zcp8\" (UID: \"3f94ae41-fbf0-4683-a7cc-0efcedaa33c9\") " pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:25.090025 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.089969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:25.146403 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.146371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:25.214349 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.214317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:25.233505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.233462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-2zcp8"] Jul 21 08:55:25.238209 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:25.238178 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f94ae41_fbf0_4683_a7cc_0efcedaa33c9.slice/crio-2140a504f7ae23932e6f130ee0abd046c53b5f29e0ad1d0ef594ec993cc9a45d WatchSource:0}: Error finding container 2140a504f7ae23932e6f130ee0abd046c53b5f29e0ad1d0ef594ec993cc9a45d: Status 404 returned error can't find the container with id 2140a504f7ae23932e6f130ee0abd046c53b5f29e0ad1d0ef594ec993cc9a45d Jul 21 08:55:25.316101 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.316051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:25.389516 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.389438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-htnwb\" (UID: \"6e3bd050-c823-4e5f-abab-2842218be495\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:25.392050 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.392022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e3bd050-c823-4e5f-abab-2842218be495-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-htnwb\" (UID: \"6e3bd050-c823-4e5f-abab-2842218be495\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:25.416043 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.416009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:25.478078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.478048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:25.535911 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.535872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-2zcp8" event={"ID":"3f94ae41-fbf0-4683-a7cc-0efcedaa33c9","Type":"ContainerStarted","Data":"2140a504f7ae23932e6f130ee0abd046c53b5f29e0ad1d0ef594ec993cc9a45d"} Jul 21 08:55:25.591165 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.591130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:25.963676 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:25.963624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:26.063291 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:26.063250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:26.351159 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:26.351125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:26.450286 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:26.450244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:26.756633 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:26.756549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:27.342828 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.342789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:27.460249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.460222 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dkcr7" Jul 21 08:55:27.576459 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.576427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:27.678493 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.678434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:27.753449 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.753413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb"] Jul 21 08:55:27.757796 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:27.757750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:27.758161 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:27.757878 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3bd050_c823_4e5f_abab_2842218be495.slice/crio-f9f253f1fc5d7e60fa558b37d600b81139bd1d00cd517b6bb01a4b9f8cf6f872 WatchSource:0}: Error finding container f9f253f1fc5d7e60fa558b37d600b81139bd1d00cd517b6bb01a4b9f8cf6f872: Status 404 returned error can't find the container with id f9f253f1fc5d7e60fa558b37d600b81139bd1d00cd517b6bb01a4b9f8cf6f872 Jul 21 08:55:28.158079 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:28.158046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:28.545942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:28.545819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" event={"ID":"6e3bd050-c823-4e5f-abab-2842218be495","Type":"ContainerStarted","Data":"f9f253f1fc5d7e60fa558b37d600b81139bd1d00cd517b6bb01a4b9f8cf6f872"} Jul 21 08:55:28.548625 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:28.548539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbdxv" event={"ID":"a787559b-1dcd-4df3-b3b7-8be95dd15210","Type":"ContainerStarted","Data":"aea70a59429baa106dcb645426672ce115a1b9c8336abbd8ccf7cc9e65e066c3"} Jul 21 08:55:28.914279 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:28.914223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:29.015163 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.015075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:29.068354 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.068313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:29.554560 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.554518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" event={"ID":"6e3bd050-c823-4e5f-abab-2842218be495","Type":"ContainerStarted","Data":"b89201cd71fea8b0e89333fba4d4bcbfcded6c19c2f2c1da18591b7de9d20f40"} Jul 21 08:55:29.554761 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.554734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:29.560673 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.560646 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" Jul 21 08:55:29.568766 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.568706 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-htnwb" podStartSLOduration=4.253160829 podStartE2EDuration="5.568685946s" totalImagesPullingTime="1.315525117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:29.56813587 +0000 UTC m=+63.921467093" watchObservedRunningTime="2026-07-21 08:55:29.568685946 +0000 UTC m=+63.922017148" Jul 21 08:55:29.698962 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.698907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:29.725500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.724592 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd"] Jul 21 08:55:29.726677 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.726651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.728894 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.728699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bq44z\"" Jul 21 08:55:29.728894 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.728717 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 08:55:29.728894 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.728886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 08:55:29.729171 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.728962 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 08:55:29.729171 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.728999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 08:55:29.729171 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.729120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 08:55:29.737172 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.737127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd"] Jul 21 08:55:29.774811 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.774774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:29.821314 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.821284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.821488 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.821368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjkp\" (UniqueName: \"kubernetes.io/projected/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-kube-api-access-svjkp\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.821488 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.821419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.821488 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.821483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.922687 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.922648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.923158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.922703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.923158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.922764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjkp\" (UniqueName: \"kubernetes.io/projected/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-kube-api-access-svjkp\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.923158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.922808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.923158 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:29.922819 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 21 08:55:29.923158 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:29.922892 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls podName:2fea3c83-7de0-46d5-9f25-bcea09a2d24e nodeName:}" failed. No retries permitted until 2026-07-21 08:55:30.422872311 +0000 UTC m=+64.776203528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-ldlgd" (UID: "2fea3c83-7de0-46d5-9f25-bcea09a2d24e") : secret "prometheus-operator-tls" not found Jul 21 08:55:29.923598 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.923553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.926002 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.925934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:29.933497 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:29.933472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjkp\" (UniqueName: \"kubernetes.io/projected/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-kube-api-access-svjkp\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:30.188817 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:30.188738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:30.427939 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:30.427893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:30.430878 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:30.430829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fea3c83-7de0-46d5-9f25-bcea09a2d24e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ldlgd\" (UID: \"2fea3c83-7de0-46d5-9f25-bcea09a2d24e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:30.638922 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:30.638883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" Jul 21 08:55:31.839728 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.839687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:31.842045 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.842017 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 08:55:31.853048 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.853019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5e94215-cf73-44e4-94fa-9f7e2ea1156b-original-pull-secret\") pod \"global-pull-secret-syncer-rzw7k\" (UID: \"a5e94215-cf73-44e4-94fa-9f7e2ea1156b\") " pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:31.902092 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.902058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzw7k" Jul 21 08:55:31.940478 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.940441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:31.942691 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.942669 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 08:55:31.954325 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:31.954293 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8ecde8-6fc0-4972-ab08-80b400b7c794-metrics-certs\") pod \"network-metrics-daemon-6r9s8\" (UID: \"9e8ecde8-6fc0-4972-ab08-80b400b7c794\") " pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:32.041350 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.041309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:32.043387 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.043360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 08:55:32.053434 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.053410 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 08:55:32.064486 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.064460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdp9r\" (UniqueName: \"kubernetes.io/projected/edac258e-34fe-4970-9ad6-4d5ac958a4e5-kube-api-access-cdp9r\") pod \"network-check-target-clwbz\" (UID: \"edac258e-34fe-4970-9ad6-4d5ac958a4e5\") " pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:32.209338 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.209308 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bsz6x\"" Jul 21 08:55:32.214130 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.214103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hlcjd\"" Jul 21 08:55:32.218181 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.218156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6r9s8" Jul 21 08:55:32.223106 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.223062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:32.230517 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.230490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd"] Jul 21 08:55:32.234217 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:32.234182 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fea3c83_7de0_46d5_9f25_bcea09a2d24e.slice/crio-925e887d6fc96ea2b3635673c380dbd4eca2273da88559dc0503122cc53a066d WatchSource:0}: Error finding container 925e887d6fc96ea2b3635673c380dbd4eca2273da88559dc0503122cc53a066d: Status 404 returned error can't find the container with id 925e887d6fc96ea2b3635673c380dbd4eca2273da88559dc0503122cc53a066d Jul 21 08:55:32.242495 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.242369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzw7k"] Jul 21 08:55:32.247669 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:32.247625 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e94215_cf73_44e4_94fa_9f7e2ea1156b.slice/crio-af30642d9c0c2d837064c5f1ebdc010c075df074080c904099ecafe4cf43fbbb WatchSource:0}: Error finding container af30642d9c0c2d837064c5f1ebdc010c075df074080c904099ecafe4cf43fbbb: Status 404 returned error can't find the container with id af30642d9c0c2d837064c5f1ebdc010c075df074080c904099ecafe4cf43fbbb Jul 21 08:55:32.364499 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.364468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6r9s8"] Jul 21 08:55:32.368259 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:32.368229 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8ecde8_6fc0_4972_ab08_80b400b7c794.slice/crio-15cd1e76e854d5bab6eb9b291175c0380806e258e5fd04885e122219bfcd210b WatchSource:0}: Error finding container 15cd1e76e854d5bab6eb9b291175c0380806e258e5fd04885e122219bfcd210b: Status 404 returned error can't find the container with id 15cd1e76e854d5bab6eb9b291175c0380806e258e5fd04885e122219bfcd210b Jul 21 08:55:32.380813 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.380758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clwbz"] Jul 21 08:55:32.384636 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:32.384609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedac258e_34fe_4970_9ad6_4d5ac958a4e5.slice/crio-6267b648cf7f9c1def12a591b9752190798815f84e5716aa39d762c615ef9353 WatchSource:0}: Error finding container 6267b648cf7f9c1def12a591b9752190798815f84e5716aa39d762c615ef9353: Status 404 returned error can't find the container with id 6267b648cf7f9c1def12a591b9752190798815f84e5716aa39d762c615ef9353 Jul 21 08:55:32.567353 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.567309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clwbz" event={"ID":"edac258e-34fe-4970-9ad6-4d5ac958a4e5","Type":"ContainerStarted","Data":"6267b648cf7f9c1def12a591b9752190798815f84e5716aa39d762c615ef9353"} Jul 21 08:55:32.568634 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.568609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6r9s8" event={"ID":"9e8ecde8-6fc0-4972-ab08-80b400b7c794","Type":"ContainerStarted","Data":"15cd1e76e854d5bab6eb9b291175c0380806e258e5fd04885e122219bfcd210b"} Jul 21 08:55:32.569885 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.569861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" event={"ID":"2fea3c83-7de0-46d5-9f25-bcea09a2d24e","Type":"ContainerStarted","Data":"925e887d6fc96ea2b3635673c380dbd4eca2273da88559dc0503122cc53a066d"} Jul 21 08:55:32.572197 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.572170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbdxv" event={"ID":"a787559b-1dcd-4df3-b3b7-8be95dd15210","Type":"ContainerStarted","Data":"7ca267e9ec4dd8868a84c57bcea43b18cab31f352b32b413d2b927c2ac51333f"} Jul 21 08:55:32.573447 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.573423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzw7k" event={"ID":"a5e94215-cf73-44e4-94fa-9f7e2ea1156b","Type":"ContainerStarted","Data":"af30642d9c0c2d837064c5f1ebdc010c075df074080c904099ecafe4cf43fbbb"} Jul 21 08:55:32.589910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:32.589848 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbdxv" podStartSLOduration=1.271768837 podStartE2EDuration="15.589826161s" totalImagesPullingTime="14.318057324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:32.589404965 +0000 UTC m=+66.942736190" watchObservedRunningTime="2026-07-21 08:55:32.589826161 +0000 UTC m=+66.943157384" Jul 21 08:55:34.538258 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.538228 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vhgd" Jul 21 08:55:34.546845 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.546784 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:34.589158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.589065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6r9s8" event={"ID":"9e8ecde8-6fc0-4972-ab08-80b400b7c794","Type":"ContainerStarted","Data":"1e38598e5f2f192e7688de2777e768912c8592cd172c499fe0dc900382138a3c"} Jul 21 08:55:34.589158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.589133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6r9s8" event={"ID":"9e8ecde8-6fc0-4972-ab08-80b400b7c794","Type":"ContainerStarted","Data":"bfdf9709a3be6b7aa4b122a893f1ae24b1a2e639983ff9ac887efdf18dcceb09"} Jul 21 08:55:34.591755 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.591728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" event={"ID":"2fea3c83-7de0-46d5-9f25-bcea09a2d24e","Type":"ContainerStarted","Data":"04067076d98c92afefeccd0a1e9317edd9cef8d51bcbb9911569eb119b8a0a5c"} Jul 21 08:55:34.591891 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.591779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" event={"ID":"2fea3c83-7de0-46d5-9f25-bcea09a2d24e","Type":"ContainerStarted","Data":"c62494f4c35dee98ee2a88ce07b72cdf58b1e5cb2eef5c2854add503fed67b0c"} Jul 21 08:55:34.625237 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.625059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6r9s8" podStartSLOduration=66.835431366 podStartE2EDuration="1m8.62504225s" totalImagesPullingTime="1.789610884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:34.606728988 +0000 UTC m=+68.960060209" watchObservedRunningTime="2026-07-21 08:55:34.62504225 +0000 UTC m=+68.978373472" Jul 21 08:55:34.625729 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.625680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ldlgd" podStartSLOduration=3.704385978 podStartE2EDuration="5.625659443s" totalImagesPullingTime="1.921273465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:34.624744113 +0000 UTC m=+68.978075334" watchObservedRunningTime="2026-07-21 08:55:34.625659443 +0000 UTC m=+68.978990667" Jul 21 08:55:34.705751 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.705638 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:34.773518 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.772464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:55:34.785317 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.785282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:34.795510 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.795485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:55:34.795679 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.795586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.797957 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.797933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-96f2k\"" Jul 21 08:55:34.799077 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.798218 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 08:55:34.799077 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.798527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 08:55:34.799077 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.798715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 08:55:34.799077 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.798820 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 08:55:34.799077 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.798909 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 08:55:34.866010 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.865520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.866336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.865585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.866336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.866244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.866336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.866282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.866515 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.866397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.866515 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.866430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbz5h\" (UniqueName: \"kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbz5h\" (UniqueName: \"kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.967557 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.967292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.968163 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.968060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.968231 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.968157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.969366 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.968712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.976751 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.976695 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.980076 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.979970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbz5h\" (UniqueName: \"kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:34.981287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:34.981263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert\") pod \"console-5949484889-m5p72\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:35.109464 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:35.109425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:35.308158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:35.308046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:55:35.312330 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:35.312292 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2550adaf_4115_4b02_aaf5_d074a02a6987.slice/crio-2dfe869257ec7d65ae1dbb85a23d665db2fb7d484315e2512dbbf3fd6c2c90e2 WatchSource:0}: Error finding container 2dfe869257ec7d65ae1dbb85a23d665db2fb7d484315e2512dbbf3fd6c2c90e2: Status 404 returned error can't find the container with id 2dfe869257ec7d65ae1dbb85a23d665db2fb7d484315e2512dbbf3fd6c2c90e2 Jul 21 08:55:35.600611 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:35.600562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5949484889-m5p72" event={"ID":"2550adaf-4115-4b02-aaf5-d074a02a6987","Type":"ContainerStarted","Data":"2dfe869257ec7d65ae1dbb85a23d665db2fb7d484315e2512dbbf3fd6c2c90e2"} Jul 21 08:55:35.847892 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:35.847858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.062033 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.061939 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.068798 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.068400 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm"] Jul 21 08:55:36.070818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.070795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.072598 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.072569 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 08:55:36.072705 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.072575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 08:55:36.073272 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.073176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h8dhq\"" Jul 21 08:55:36.084688 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.084616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm"] Jul 21 08:55:36.087879 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.087856 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7bgr"] Jul 21 08:55:36.090247 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.090212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.092276 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.092253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 08:55:36.092393 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.092378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 08:55:36.092538 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.092513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r6h9f\"" Jul 21 08:55:36.092729 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.092713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 08:55:36.097411 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.097392 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tnm89"] Jul 21 08:55:36.099677 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.099656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.101767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.101748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 08:55:36.103327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.103306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 08:55:36.103327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.103319 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8s4wl\"" Jul 21 08:55:36.103754 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.103456 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 08:55:36.104333 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.104310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7bgr"] Jul 21 08:55:36.147600 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.147568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.177651 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-textfile\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.177651 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxdv\" (UniqueName: \"kubernetes.io/projected/f826b168-a640-4d08-87de-cda8d3d0202c-kube-api-access-wkxdv\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5mzp\" (UniqueName: \"kubernetes.io/projected/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-api-access-n5mzp\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-metrics-client-ca\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-sys\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f826b168-a640-4d08-87de-cda8d3d0202c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.177910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-root\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.177965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-wtmp\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.178240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.178643 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.178252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqds\" (UniqueName: \"kubernetes.io/projected/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-kube-api-access-szqds\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.208623 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.208590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.278867 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-wtmp\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.278974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqds\" (UniqueName: \"kubernetes.io/projected/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-kube-api-access-szqds\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279078 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-textfile\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxdv\" (UniqueName: \"kubernetes.io/projected/f826b168-a640-4d08-87de-cda8d3d0202c-kube-api-access-wkxdv\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5mzp\" (UniqueName: \"kubernetes.io/projected/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-api-access-n5mzp\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-metrics-client-ca\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-sys\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f826b168-a640-4d08-87de-cda8d3d0202c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-root\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.279433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.279416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:36.279967 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:36.280056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls podName:88c4f6e1-754c-4ca5-8f00-d230dedbb20c nodeName:}" failed. No retries permitted until 2026-07-21 08:55:36.780035842 +0000 UTC m=+71.133367061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls") pod "node-exporter-tnm89" (UID: "88c4f6e1-754c-4ca5-8f00-d230dedbb20c") : secret "node-exporter-tls" not found Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-root\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-sys\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280275 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f826b168-a640-4d08-87de-cda8d3d0202c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-metrics-client-ca\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-textfile\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.280969 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.281158 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.281114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-wtmp\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.281830 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.281444 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.283501 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.283475 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.283663 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.283627 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.284041 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.284000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.284339 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.284318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f826b168-a640-4d08-87de-cda8d3d0202c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.285270 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.285251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.290912 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.290888 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxdv\" (UniqueName: \"kubernetes.io/projected/f826b168-a640-4d08-87de-cda8d3d0202c-kube-api-access-wkxdv\") pod \"openshift-state-metrics-79f6958cdf-tppvm\" (UID: \"f826b168-a640-4d08-87de-cda8d3d0202c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.295167 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.295141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5mzp\" (UniqueName: \"kubernetes.io/projected/688d8a27-3b0f-400b-9b2a-c748eb9ea5c5-kube-api-access-n5mzp\") pod \"kube-state-metrics-56c5594674-m7bgr\" (UID: \"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.295640 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.295582 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqds\" (UniqueName: \"kubernetes.io/projected/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-kube-api-access-szqds\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.320526 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.320484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.383272 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.383237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" Jul 21 08:55:36.402015 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.401954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" Jul 21 08:55:36.421954 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.421916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.720306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.720223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:36.784220 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.784180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:36.787344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:36.787317 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88c4f6e1-754c-4ca5-8f00-d230dedbb20c-node-exporter-tls\") pod \"node-exporter-tnm89\" (UID: \"88c4f6e1-754c-4ca5-8f00-d230dedbb20c\") " pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:37.014441 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.014145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnm89" Jul 21 08:55:37.064644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.064609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:37.139386 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.139352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:37.143275 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.143243 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:37.146417 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.146392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.148298 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.148276 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 08:55:37.148503 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.148484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 08:55:37.148708 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.148688 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 08:55:37.148812 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.148757 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 08:55:37.149492 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x74tv\"" Jul 21 08:55:37.149492 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149098 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 08:55:37.149492 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149299 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 08:55:37.149492 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149336 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 08:55:37.149781 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149545 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 08:55:37.149781 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.149619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 08:55:37.164561 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.164530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:37.287907 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.287822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.287907 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.287871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.287907 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.287891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.287957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4d7t\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288207 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288465 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288465 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.288465 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.288326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.370525 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.370491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:37.389757 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.389930 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.389930 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.389930 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.389930 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.389930 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.389997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4d7t\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.390210 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.391212 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.391212 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:55:37.390761 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle podName:809292f2-fe36-499f-b8d8-fe4dffe85068 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:37.890734133 +0000 UTC m=+72.244065353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068") : configmap references non-existent config key: ca-bundle.crt Jul 21 08:55:37.391212 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.390877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.393910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.393886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394168 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394168 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394089 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394694 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394694 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394845 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.394845 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.394724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.396260 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.396226 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.396376 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.396295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.398410 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.398390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4d7t\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.894912 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.894871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:37.895850 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:37.895822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:38.054618 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.054579 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-749558d878-86tl9"] Jul 21 08:55:38.058151 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.058130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.058554 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.058343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:38.060358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 08:55:38.060358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060245 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 08:55:38.060358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 08:55:38.060358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060308 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kftww\"" Jul 21 08:55:38.060538 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 08:55:38.060595 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 08:55:38.060811 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.060793 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-57dicrfas4u0l\"" Jul 21 08:55:38.068871 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.068851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-749558d878-86tl9"] Jul 21 08:55:38.197963 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.197882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.197963 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.197932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.197963 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.197952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.198249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.197992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-grpc-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.198249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.198091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-metrics-client-ca\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.198249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.198131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.198249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.198172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.198249 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.198213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbprg\" (UniqueName: \"kubernetes.io/projected/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-kube-api-access-sbprg\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298634 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-grpc-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-metrics-client-ca\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbprg\" (UniqueName: \"kubernetes.io/projected/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-kube-api-access-sbprg\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.298964 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.298903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.299506 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.299481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-metrics-client-ca\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.301973 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.301944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.302236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.302210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.302338 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.302264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.302734 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.302713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-grpc-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.302785 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.302735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-tls\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.302785 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.302718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.306542 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.306498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbprg\" (UniqueName: \"kubernetes.io/projected/917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b-kube-api-access-sbprg\") pod \"thanos-querier-749558d878-86tl9\" (UID: \"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b\") " pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.369516 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.369481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:38.985321 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:38.985286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:39.086801 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:39.086766 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:39.141122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:39.141087 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:39.235082 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:39.235037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:39.559321 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:39.559286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:39.660311 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:39.660272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:40.368314 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.368271 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5694b6c85d-6dgrc"] Jul 21 08:55:40.378506 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.378476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.380631 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.380608 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 08:55:40.381629 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.381424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-825937cjo7u3v\"" Jul 21 08:55:40.381629 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.381459 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 08:55:40.381629 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.381558 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wlgkq\"" Jul 21 08:55:40.381866 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.381664 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 08:55:40.381866 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.381692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 08:55:40.382624 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.382599 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5694b6c85d-6dgrc"] Jul 21 08:55:40.524041 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-client-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-client-certs\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3f68f96-980d-411c-b056-f2bb8acfd950-audit-log\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524229 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5vmq\" (UniqueName: \"kubernetes.io/projected/e3f68f96-980d-411c-b056-f2bb8acfd950-kube-api-access-l5vmq\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524420 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-tls\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.524420 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.524327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-metrics-server-audit-profiles\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625272 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5vmq\" (UniqueName: \"kubernetes.io/projected/e3f68f96-980d-411c-b056-f2bb8acfd950-kube-api-access-l5vmq\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625272 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-tls\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-metrics-server-audit-profiles\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-client-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-client-certs\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625505 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3f68f96-980d-411c-b056-f2bb8acfd950-audit-log\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.625820 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.625800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3f68f96-980d-411c-b056-f2bb8acfd950-audit-log\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.626232 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.626204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.626387 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.626362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3f68f96-980d-411c-b056-f2bb8acfd950-metrics-server-audit-profiles\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.628216 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.628197 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-client-certs\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.628480 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.628457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-secret-metrics-server-tls\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.628914 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.628890 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3f68f96-980d-411c-b056-f2bb8acfd950-client-ca-bundle\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.633000 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.632966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5vmq\" (UniqueName: \"kubernetes.io/projected/e3f68f96-980d-411c-b056-f2bb8acfd950-kube-api-access-l5vmq\") pod \"metrics-server-5694b6c85d-6dgrc\" (UID: \"e3f68f96-980d-411c-b056-f2bb8acfd950\") " pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.690963 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.690914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:55:40.847949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.847911 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:40.851097 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.851069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv"] Jul 21 08:55:40.865408 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.865370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv"] Jul 21 08:55:40.865564 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.865488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:40.867745 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.867529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4rkph\"" Jul 21 08:55:40.867745 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.867568 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 08:55:40.906447 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.906333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:40.928324 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.928287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9lv\" (UniqueName: \"kubernetes.io/projected/f27b019b-88ca-48d0-866d-ae52269afcbd-kube-api-access-qz9lv\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:40.928473 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.928335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f27b019b-88ca-48d0-866d-ae52269afcbd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:40.965385 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:40.965340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:41.029694 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:41.029654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9lv\" (UniqueName: \"kubernetes.io/projected/f27b019b-88ca-48d0-866d-ae52269afcbd-kube-api-access-qz9lv\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:41.029872 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:41.029708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f27b019b-88ca-48d0-866d-ae52269afcbd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:41.032427 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:41.032397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f27b019b-88ca-48d0-866d-ae52269afcbd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:41.037089 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:41.037061 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9lv\" (UniqueName: \"kubernetes.io/projected/f27b019b-88ca-48d0-866d-ae52269afcbd-kube-api-access-qz9lv\") pod \"monitoring-plugin-7b7b7bc8bf-xtjhv\" (UID: \"f27b019b-88ca-48d0-866d-ae52269afcbd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:41.177856 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:41.177765 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:42.297205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.297163 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:42.300010 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.299935 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:42.390263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.390229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:42.390476 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.390411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.392560 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.392521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 08:55:42.392719 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.392703 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 08:55:42.392836 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.392801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.396364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.396520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.396963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.397104 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.397338 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.397628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.397103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 08:55:42.398487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.397828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 08:55:42.399089 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.399040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 08:55:42.399794 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.399775 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-avnui3b3oh4h3\"" Jul 21 08:55:42.400241 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.400136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-89qfm\"" Jul 21 08:55:42.402707 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.402686 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 08:55:42.405240 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.405222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwx6\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.548491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.549558 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.548611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649334 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649334 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwx6\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649579 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.649942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.649879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.651487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.650287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.651487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.650660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.651487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.650667 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.652561 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.652526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.652671 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.652558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.653327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.652828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.653737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.653422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.653737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.653490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.653737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.653610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.653737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.653660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.654146 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.654107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.654243 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.654177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.655035 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.654748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.655457 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.655423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.657586 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.657547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.658616 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.658595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.659452 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.659371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.660179 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.660140 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.661364 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.661318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.663680 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.663649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwx6\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6\") pod \"prometheus-k8s-0\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.707409 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.707371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:42.944149 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.944114 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:42.997826 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:42.997793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:43.653727 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:43.653689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:43.705550 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:43.705513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:44.169762 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:44.169712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:44.223992 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:44.223942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:45.944674 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:45.944613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7bgr"] Jul 21 08:55:45.975596 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:45.975568 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:46.123560 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:46.123515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:46.221092 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:46.221062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:47.065283 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.065251 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688d8a27_3b0f_400b_9b2a_c748eb9ea5c5.slice/crio-696b707e3157cca450cfb50144ec9c7416db00c6e85c490929cd61a2eb005b50 WatchSource:0}: Error finding container 696b707e3157cca450cfb50144ec9c7416db00c6e85c490929cd61a2eb005b50: Status 404 returned error can't find the container with id 696b707e3157cca450cfb50144ec9c7416db00c6e85c490929cd61a2eb005b50 Jul 21 08:55:47.066512 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.066473 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809292f2_fe36_499f_b8d8_fe4dffe85068.slice/crio-4d73e7a8642b0a9f56079dc8e1001e3188def3c648f6cd2a0ba608540bc6de30 WatchSource:0}: Error finding container 4d73e7a8642b0a9f56079dc8e1001e3188def3c648f6cd2a0ba608540bc6de30: Status 404 returned error can't find the container with id 4d73e7a8642b0a9f56079dc8e1001e3188def3c648f6cd2a0ba608540bc6de30 Jul 21 08:55:47.218334 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.218121 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:47.272286 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.272248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm"] Jul 21 08:55:47.282418 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.282359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:47.302438 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.302337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:47.306049 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.305947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv"] Jul 21 08:55:47.327340 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.327295 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf826b168_a640_4d08_87de_cda8d3d0202c.slice/crio-dfdb32ad9168ea1322e6568ac09a612c6e69106a4012459d16c0bef4558c2ed7 WatchSource:0}: Error finding container dfdb32ad9168ea1322e6568ac09a612c6e69106a4012459d16c0bef4558c2ed7: Status 404 returned error can't find the container with id dfdb32ad9168ea1322e6568ac09a612c6e69106a4012459d16c0bef4558c2ed7 Jul 21 08:55:47.328865 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.328135 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba12d2d8_0df7_44d0_a28f_1f0f3be56123.slice/crio-c7e636fbdcb553ab2110c0004ef5df8277a247c6007eb12db2fdc15fedf23fca WatchSource:0}: Error finding container c7e636fbdcb553ab2110c0004ef5df8277a247c6007eb12db2fdc15fedf23fca: Status 404 returned error can't find the container with id c7e636fbdcb553ab2110c0004ef5df8277a247c6007eb12db2fdc15fedf23fca Jul 21 08:55:47.328939 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.328926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27b019b_88ca_48d0_866d_ae52269afcbd.slice/crio-a8ebb12daf01a55f6830c9954223c7d8eb4b057717c063a60b81e2382b591447 WatchSource:0}: Error finding container a8ebb12daf01a55f6830c9954223c7d8eb4b057717c063a60b81e2382b591447: Status 404 returned error can't find the container with id a8ebb12daf01a55f6830c9954223c7d8eb4b057717c063a60b81e2382b591447 Jul 21 08:55:47.333598 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.333576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5694b6c85d-6dgrc"] Jul 21 08:55:47.336489 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.336470 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f68f96_980d_411c_b056_f2bb8acfd950.slice/crio-1ee4851c8981f6a6d5cacdbcca8959e6f0ea6da5fe661d73539481b05f656e64 WatchSource:0}: Error finding container 1ee4851c8981f6a6d5cacdbcca8959e6f0ea6da5fe661d73539481b05f656e64: Status 404 returned error can't find the container with id 1ee4851c8981f6a6d5cacdbcca8959e6f0ea6da5fe661d73539481b05f656e64 Jul 21 08:55:47.341384 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.341359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-749558d878-86tl9"] Jul 21 08:55:47.343794 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:55:47.343772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917e0ea7_bff9_4d4a_8ef3_2a91c63d3e0b.slice/crio-d735c6803bdfb6845fb5b7d0e9cb72828a49f6b200e6c768ad0fa6d84b556255 WatchSource:0}: Error finding container d735c6803bdfb6845fb5b7d0e9cb72828a49f6b200e6c768ad0fa6d84b556255: Status 404 returned error can't find the container with id d735c6803bdfb6845fb5b7d0e9cb72828a49f6b200e6c768ad0fa6d84b556255 Jul 21 08:55:47.660400 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.660359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clwbz" event={"ID":"edac258e-34fe-4970-9ad6-4d5ac958a4e5","Type":"ContainerStarted","Data":"1caf5d5ac18061a10edd79cd1b520ea8aa47af161a734188eb22b80298caba53"} Jul 21 08:55:47.660586 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.660525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:55:47.662395 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.662363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5949484889-m5p72" event={"ID":"2550adaf-4115-4b02-aaf5-d074a02a6987","Type":"ContainerStarted","Data":"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c"} Jul 21 08:55:47.665653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.665359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-2zcp8" event={"ID":"3f94ae41-fbf0-4683-a7cc-0efcedaa33c9","Type":"ContainerStarted","Data":"657256af9a07c6e8f9a8454f48edc28fdb5ebe01c643264cadf89a117a92bee4"} Jul 21 08:55:47.665653 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.665619 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:47.666942 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.666887 2576 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-2zcp8 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body= Jul 21 08:55:47.667216 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.667175 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-2zcp8" podUID="3f94ae41-fbf0-4683-a7cc-0efcedaa33c9" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" Jul 21 08:55:47.668012 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.667744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzw7k" event={"ID":"a5e94215-cf73-44e4-94fa-9f7e2ea1156b","Type":"ContainerStarted","Data":"c1ef1a7e8ea025a6f24ead3bfd3d1dadab54f802df7c48ffae043263a9aa34b8"} Jul 21 08:55:47.669544 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.669486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"d735c6803bdfb6845fb5b7d0e9cb72828a49f6b200e6c768ad0fa6d84b556255"} Jul 21 08:55:47.671000 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.670961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" event={"ID":"e3f68f96-980d-411c-b056-f2bb8acfd950","Type":"ContainerStarted","Data":"1ee4851c8981f6a6d5cacdbcca8959e6f0ea6da5fe661d73539481b05f656e64"} Jul 21 08:55:47.672374 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.672309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"c7e636fbdcb553ab2110c0004ef5df8277a247c6007eb12db2fdc15fedf23fca"} Jul 21 08:55:47.673829 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.673803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" event={"ID":"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5","Type":"ContainerStarted","Data":"696b707e3157cca450cfb50144ec9c7416db00c6e85c490929cd61a2eb005b50"} Jul 21 08:55:47.675740 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.675719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" event={"ID":"f27b019b-88ca-48d0-866d-ae52269afcbd","Type":"ContainerStarted","Data":"a8ebb12daf01a55f6830c9954223c7d8eb4b057717c063a60b81e2382b591447"} Jul 21 08:55:47.675922 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.675757 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-clwbz" podStartSLOduration=67.003594321 podStartE2EDuration="1m21.675743096s" totalImagesPullingTime="14.672148775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:47.675033993 +0000 UTC m=+82.028365216" watchObservedRunningTime="2026-07-21 08:55:47.675743096 +0000 UTC m=+82.029074316" Jul 21 08:55:47.680303 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.680163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" event={"ID":"f826b168-a640-4d08-87de-cda8d3d0202c","Type":"ContainerStarted","Data":"3dc9cba7f54336eb28dc429b4837717703987f101cffcb437548db60f6b90829"} Jul 21 08:55:47.680303 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.680219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" event={"ID":"f826b168-a640-4d08-87de-cda8d3d0202c","Type":"ContainerStarted","Data":"73bd7a68db7f96d32e9d9f43aa27f39119bc381366cf43d9de3382df93016181"} Jul 21 08:55:47.680303 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.680262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" event={"ID":"f826b168-a640-4d08-87de-cda8d3d0202c","Type":"ContainerStarted","Data":"dfdb32ad9168ea1322e6568ac09a612c6e69106a4012459d16c0bef4558c2ed7"} Jul 21 08:55:47.684264 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.684215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnm89" event={"ID":"88c4f6e1-754c-4ca5-8f00-d230dedbb20c","Type":"ContainerStarted","Data":"3f9e40e06474f2e9a983ea0bb9c651d3837737b11c4e4184e55c6d93774ff7a1"} Jul 21 08:55:47.691502 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.690236 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rzw7k" podStartSLOduration=66.881098469 podStartE2EDuration="1m21.690221278s" totalImagesPullingTime="14.809122809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:47.688578643 +0000 UTC m=+82.041909866" watchObservedRunningTime="2026-07-21 08:55:47.690221278 +0000 UTC m=+82.043552501" Jul 21 08:55:47.691502 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.691308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"4d73e7a8642b0a9f56079dc8e1001e3188def3c648f6cd2a0ba608540bc6de30"} Jul 21 08:55:47.692756 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.692304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:47.708137 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.707669 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5949484889-m5p72" podStartSLOduration=1.644179796 podStartE2EDuration="13.707649725s" totalImagesPullingTime="12.063469929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:47.706053905 +0000 UTC m=+82.059385153" watchObservedRunningTime="2026-07-21 08:55:47.707649725 +0000 UTC m=+82.060980949" Jul 21 08:55:47.723926 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.723106 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-2zcp8" podStartSLOduration=1.8865605570000001 podStartE2EDuration="23.723086025s" totalImagesPullingTime="21.836525468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:47.722872679 +0000 UTC m=+82.076203900" watchObservedRunningTime="2026-07-21 08:55:47.723086025 +0000 UTC m=+82.076417250" Jul 21 08:55:47.787758 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.787686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:47.844521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:47.844408 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:48.719442 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:48.719416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-2zcp8" Jul 21 08:55:52.006775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:52.006735 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:52.106698 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:52.106651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:52.675263 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:52.675196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:52.776106 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:52.776057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:53.269939 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.269909 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:55:53.405303 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.405258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:53.499046 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.499017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:53.603905 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.603871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:53.703929 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.703848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:53.735500 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.735399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"1d7886f74ceeb5bf7d482a153fa11057aceb578166aaaa7dfa53a59264d3b5e6"} Jul 21 08:55:53.737643 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.737530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" event={"ID":"e3f68f96-980d-411c-b056-f2bb8acfd950","Type":"ContainerStarted","Data":"c0495d71e2037b0776d11e39dd69ccc49bceb36a88e7ecce2176a123d7129a1c"} Jul 21 08:55:53.739512 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.739444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" event={"ID":"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5","Type":"ContainerStarted","Data":"6cd4bac200ed2c07d151bb9dcf4a2eccccabe045a95090dab9ad5ef5ec6de873"} Jul 21 08:55:53.745571 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:53.745482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0"} Jul 21 08:55:54.248769 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.248726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:54.345967 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.345928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:54.752117 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.752028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"0518cd612793b431527cccdd9660e1877372b9f761f6657b14fbb786177814e2"} Jul 21 08:55:54.752311 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.752149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"156aec2dd73d632fd6d6409afe7a7902ad415fa925b11f935e58b05425bbe81c"} Jul 21 08:55:54.753784 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.753757 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" exitCode=0 Jul 21 08:55:54.753941 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.753845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} Jul 21 08:55:54.757116 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.756503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" event={"ID":"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5","Type":"ContainerStarted","Data":"8dac2cb7c2618e905c5b76b3767020b17eef5e947b1c8a46a60589bc6490b5c0"} Jul 21 08:55:54.757116 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.756576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" event={"ID":"688d8a27-3b0f-400b-9b2a-c748eb9ea5c5","Type":"ContainerStarted","Data":"4c056c40834a570a4ca18aa0f3367fe40f28f9d361202c8724e04a5e76f0244a"} Jul 21 08:55:54.758522 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.758388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" event={"ID":"f27b019b-88ca-48d0-866d-ae52269afcbd","Type":"ContainerStarted","Data":"b52275790571849994a3fff8d1e87454e97c74c8d903b2c94f1b8a7ac822892b"} Jul 21 08:55:54.758957 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.758938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:54.761615 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.761591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" event={"ID":"f826b168-a640-4d08-87de-cda8d3d0202c","Type":"ContainerStarted","Data":"ace9bf0c85892da5a175898b14d978aee46226df248d9553f57cc8a970d568d1"} Jul 21 08:55:54.765009 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.764910 2576 generic.go:356] "Generic (PLEG): container finished" podID="88c4f6e1-754c-4ca5-8f00-d230dedbb20c" containerID="cd984798cb09b0a2e657587c19eef707b0f8ea219036b6838fc7879354bc1693" exitCode=0 Jul 21 08:55:54.765009 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.765043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnm89" event={"ID":"88c4f6e1-754c-4ca5-8f00-d230dedbb20c","Type":"ContainerDied","Data":"cd984798cb09b0a2e657587c19eef707b0f8ea219036b6838fc7879354bc1693"} Jul 21 08:55:54.765369 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.765350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" Jul 21 08:55:54.767313 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.767290 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0" exitCode=0 Jul 21 08:55:54.767433 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.767408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0"} Jul 21 08:55:54.781564 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.781472 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" podStartSLOduration=8.708202417 podStartE2EDuration="14.781452642s" totalImagesPullingTime="6.073250225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:53.781123682 +0000 UTC m=+88.134454913" watchObservedRunningTime="2026-07-21 08:55:54.781452642 +0000 UTC m=+89.134783866" Jul 21 08:55:54.819880 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.818513 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xtjhv" podStartSLOduration=8.70216318 podStartE2EDuration="14.818488785s" totalImagesPullingTime="6.116325605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:54.816624937 +0000 UTC m=+89.169956160" watchObservedRunningTime="2026-07-21 08:55:54.818488785 +0000 UTC m=+89.171820008" Jul 21 08:55:54.856256 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.856206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7bgr" podStartSLOduration=12.484615961 podStartE2EDuration="18.856182783s" totalImagesPullingTime="6.371566822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:54.852620391 +0000 UTC m=+89.205951639" watchObservedRunningTime="2026-07-21 08:55:54.856182783 +0000 UTC m=+89.209514211" Jul 21 08:55:54.868621 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:54.868488 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-tppvm" podStartSLOduration=12.990998891 podStartE2EDuration="18.868466463s" totalImagesPullingTime="5.877467572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:54.868300606 +0000 UTC m=+89.221631842" watchObservedRunningTime="2026-07-21 08:55:54.868466463 +0000 UTC m=+89.221797684" Jul 21 08:55:55.109993 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.109952 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5949484889-m5p72" Jul 21 08:55:55.778797 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.778604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"d27368b817155a3bd0a0f3b9003fb8486c0298dbf4c0adc5fb83d35593436939"} Jul 21 08:55:55.778797 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.778727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"2cb64b76541a0438b4e7f3d8aa18c92de40928538aa5d61f61d25b8035b62e3e"} Jul 21 08:55:55.784875 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.784818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnm89" event={"ID":"88c4f6e1-754c-4ca5-8f00-d230dedbb20c","Type":"ContainerStarted","Data":"455c9a7db9c6f06a24e29b233a6661b32ee460e1f8b024d685dcfdd30faab144"} Jul 21 08:55:55.784875 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.784870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnm89" event={"ID":"88c4f6e1-754c-4ca5-8f00-d230dedbb20c","Type":"ContainerStarted","Data":"de98467ce6e061a95f8d12d1e631620c7cd36c553be526f9f4e95ea3a6404158"} Jul 21 08:55:55.802007 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:55.801934 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tnm89" podStartSLOduration=13.258175499 podStartE2EDuration="19.801913647s" totalImagesPullingTime="6.365826572s" totalInitContainerRuntime="177.911576ms" isStatefulPod=true podCreationTimestamp="2026-07-21 08:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:55.800246794 +0000 UTC m=+90.153578017" watchObservedRunningTime="2026-07-21 08:55:55.801913647 +0000 UTC m=+90.155244869" Jul 21 08:55:56.748976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:56.748941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:56.794006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:56.793952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" event={"ID":"917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b","Type":"ContainerStarted","Data":"20b4c23cb3d74b2811498b476c860a0b40c9f02e5276b2c84935edeb10e4a8d2"} Jul 21 08:55:56.794633 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:56.794485 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:55:56.824634 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:56.824572 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" podStartSLOduration=11.440264264 podStartE2EDuration="18.824541249s" totalImagesPullingTime="7.384276985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:56.822808522 +0000 UTC m=+91.176139785" watchObservedRunningTime="2026-07-21 08:55:56.824541249 +0000 UTC m=+91.177872471" Jul 21 08:55:56.827613 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:56.827578 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:55:57.800178 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:57.800143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687"} Jul 21 08:55:58.806949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:58.806859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c"} Jul 21 08:55:58.806949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:58.806934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79"} Jul 21 08:55:59.816226 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.816186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d"} Jul 21 08:55:59.816687 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.816279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8"} Jul 21 08:55:59.816687 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.816322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerStarted","Data":"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e"} Jul 21 08:55:59.819913 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.819882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} Jul 21 08:55:59.820042 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.819936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} Jul 21 08:55:59.820042 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.819964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} Jul 21 08:55:59.820042 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.820020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} Jul 21 08:55:59.820156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.820046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} Jul 21 08:55:59.820156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.820069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerStarted","Data":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} Jul 21 08:55:59.846091 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.846027 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=14.099878665 podStartE2EDuration="22.846005794s" totalImagesPullingTime="8.730964887s" totalInitContainerRuntime="15.162242ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:59.844690259 +0000 UTC m=+94.198021482" watchObservedRunningTime="2026-07-21 08:55:59.846005794 +0000 UTC m=+94.199337016" Jul 21 08:55:59.869837 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:55:59.869775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.5639677039999995 podStartE2EDuration="17.86975325s" totalImagesPullingTime="10.286795496s" totalInitContainerRuntime="18.99005ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:59.869127439 +0000 UTC m=+94.222458664" watchObservedRunningTime="2026-07-21 08:55:59.86975325 +0000 UTC m=+94.223084474" Jul 21 08:56:00.691437 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:00.691395 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:56:00.691695 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:00.691461 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:56:02.707819 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:02.707781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:02.806722 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:02.806692 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-749558d878-86tl9" Jul 21 08:56:04.292646 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:04.292619 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gs9pd_33fbe434-8225-4bb5-81f2-8f1eec91fc40/serve-healthcheck-canary/0.log" Jul 21 08:56:10.288482 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:10.288442 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:10.344087 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:10.344033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:14.008338 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:14.008301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:14.061612 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:14.061563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:18.293336 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.293287 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5949484889-m5p72" podUID="2550adaf-4115-4b02-aaf5-d074a02a6987" containerName="console" containerID="cri-o://d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c" gracePeriod=15 Jul 21 08:56:18.610669 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.610637 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5949484889-m5p72" Jul 21 08:56:18.711540 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.711513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-clwbz" Jul 21 08:56:18.716676 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.716810 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.716810 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716712 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.716810 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716729 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbz5h\" (UniqueName: \"kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.716810 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716768 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.716810 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.716798 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert\") pod \"2550adaf-4115-4b02-aaf5-d074a02a6987\" (UID: \"2550adaf-4115-4b02-aaf5-d074a02a6987\") " Jul 21 08:56:18.717156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.717076 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config" (OuterVolumeSpecName: "console-config") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:18.717156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.717082 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca" (OuterVolumeSpecName: "service-ca") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:18.717316 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.717295 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:18.719173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.719136 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:18.719173 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.719154 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h" (OuterVolumeSpecName: "kube-api-access-pbz5h") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "kube-api-access-pbz5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:18.719302 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.719271 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2550adaf-4115-4b02-aaf5-d074a02a6987" (UID: "2550adaf-4115-4b02-aaf5-d074a02a6987"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818599 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-console-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818638 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-service-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818652 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818666 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbz5h\" (UniqueName: \"kubernetes.io/projected/2550adaf-4115-4b02-aaf5-d074a02a6987-kube-api-access-pbz5h\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818681 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2550adaf-4115-4b02-aaf5-d074a02a6987-console-oauth-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.819174 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.818697 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2550adaf-4115-4b02-aaf5-d074a02a6987-oauth-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:18.903379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.903341 2576 generic.go:356] "Generic (PLEG): container finished" podID="2550adaf-4115-4b02-aaf5-d074a02a6987" containerID="d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c" exitCode=0 Jul 21 08:56:18.903379 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.903380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5949484889-m5p72" event={"ID":"2550adaf-4115-4b02-aaf5-d074a02a6987","Type":"ContainerDied","Data":"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c"} Jul 21 08:56:18.903608 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.903389 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5949484889-m5p72" Jul 21 08:56:18.903608 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.903427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5949484889-m5p72" event={"ID":"2550adaf-4115-4b02-aaf5-d074a02a6987","Type":"ContainerDied","Data":"2dfe869257ec7d65ae1dbb85a23d665db2fb7d484315e2512dbbf3fd6c2c90e2"} Jul 21 08:56:18.903608 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.903452 2576 scope.go:117] "RemoveContainer" containerID="d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c" Jul 21 08:56:18.913591 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.913574 2576 scope.go:117] "RemoveContainer" containerID="d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c" Jul 21 08:56:18.913840 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:18.913822 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c\": container with ID starting with d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c not found: ID does not exist" containerID="d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c" Jul 21 08:56:18.913903 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.913847 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c"} err="failed to get container status \"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c\": rpc error: code = NotFound desc = could not find container \"d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c\": container with ID starting with d9ef36cd0fa3c026626bbbc1b2f10655fb412b1237f4e879cd19ba59ca780b4c not found: ID does not exist" Jul 21 08:56:18.925140 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.925104 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:56:18.929654 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:18.929618 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5949484889-m5p72"] Jul 21 08:56:20.200585 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:20.200551 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2550adaf-4115-4b02-aaf5-d074a02a6987" path="/var/lib/kubelet/pods/2550adaf-4115-4b02-aaf5-d074a02a6987/volumes" Jul 21 08:56:20.696929 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:20.696900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:56:20.700580 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:20.700552 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5694b6c85d-6dgrc" Jul 21 08:56:22.422130 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:22.422094 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:22.523774 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:22.523738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:22.577667 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:22.577633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:42.707909 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:42.707870 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:42.761369 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:42.761341 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.014766 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:43.014688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:47.412248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:47.412216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:55.275867 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:55.275821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:55.512735 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:55.512699 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:56:56.366287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366257 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:56.366721 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366541 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="alertmanager" containerID="cri-o://30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" gracePeriod=120 Jul 21 08:56:56.366721 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366635 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-web" containerID="cri-o://ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" gracePeriod=120 Jul 21 08:56:56.366858 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366620 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-metric" containerID="cri-o://62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" gracePeriod=120 Jul 21 08:56:56.366858 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366649 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy" containerID="cri-o://a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" gracePeriod=120 Jul 21 08:56:56.366969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366676 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="prom-label-proxy" containerID="cri-o://d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" gracePeriod=120 Jul 21 08:56:56.366969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:56.366672 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="config-reloader" containerID="cri-o://08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" gracePeriod=120 Jul 21 08:56:57.053839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053807 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" exitCode=0 Jul 21 08:56:57.053839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053833 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" exitCode=0 Jul 21 08:56:57.053839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053840 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" exitCode=0 Jul 21 08:56:57.053839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053846 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" exitCode=0 Jul 21 08:56:57.054121 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d"} Jul 21 08:56:57.054121 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.053971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e"} Jul 21 08:56:57.054121 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.054015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79"} Jul 21 08:56:57.054121 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.054039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687"} Jul 21 08:56:57.612676 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.612646 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:57.641889 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.641859 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642070 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.641904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4d7t\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642070 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.641936 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642070 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.641961 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642070 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642070 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642172 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642252 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642281 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.642344 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.642322 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") pod \"809292f2-fe36-499f-b8d8-fe4dffe85068\" (UID: \"809292f2-fe36-499f-b8d8-fe4dffe85068\") " Jul 21 08:56:57.643474 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.643012 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:57.643474 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.643152 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:57.643474 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.643220 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:57.649532 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.649384 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume" (OuterVolumeSpecName: "config-volume") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.649664 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.649596 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.649729 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.649662 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t" (OuterVolumeSpecName: "kube-api-access-w4d7t") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "kube-api-access-w4d7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:57.649729 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.649525 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:57.650038 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.649927 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out" (OuterVolumeSpecName: "config-out") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:57.650447 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.650399 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.650559 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.650471 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.650636 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.650610 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.655236 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.655207 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.663473 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.663408 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config" (OuterVolumeSpecName: "web-config") pod "809292f2-fe36-499f-b8d8-fe4dffe85068" (UID: "809292f2-fe36-499f-b8d8-fe4dffe85068"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:57.742965 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.742933 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-main-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.742965 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.742959 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4d7t\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-kube-api-access-w4d7t\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.742965 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.742970 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.742997 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-config-volume\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743008 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/809292f2-fe36-499f-b8d8-fe4dffe85068-tls-assets\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743017 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743025 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-cluster-tls-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743033 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743062 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/809292f2-fe36-499f-b8d8-fe4dffe85068-web-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743071 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-config-out\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743079 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-main-db\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743087 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-metrics-client-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:57.743208 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:57.743095 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809292f2-fe36-499f-b8d8-fe4dffe85068-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:56:58.061058 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.060952 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" exitCode=0 Jul 21 08:56:58.061058 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.060997 2576 generic.go:356] "Generic (PLEG): container finished" podID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerID="ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" exitCode=0 Jul 21 08:56:58.061058 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.061024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8"} Jul 21 08:56:58.061058 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.061046 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.061287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.061099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c"} Jul 21 08:56:58.061287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.061129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"809292f2-fe36-499f-b8d8-fe4dffe85068","Type":"ContainerDied","Data":"4d73e7a8642b0a9f56079dc8e1001e3188def3c648f6cd2a0ba608540bc6de30"} Jul 21 08:56:58.061287 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.061167 2576 scope.go:117] "RemoveContainer" containerID="d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" Jul 21 08:56:58.069349 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.069334 2576 scope.go:117] "RemoveContainer" containerID="62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" Jul 21 08:56:58.076754 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.076735 2576 scope.go:117] "RemoveContainer" containerID="a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" Jul 21 08:56:58.083137 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.083122 2576 scope.go:117] "RemoveContainer" containerID="ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" Jul 21 08:56:58.087235 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.087213 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:58.090598 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.090583 2576 scope.go:117] "RemoveContainer" containerID="08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" Jul 21 08:56:58.094039 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.094019 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:58.098182 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.098166 2576 scope.go:117] "RemoveContainer" containerID="30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" Jul 21 08:56:58.104726 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.104710 2576 scope.go:117] "RemoveContainer" containerID="4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0" Jul 21 08:56:58.111405 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.111386 2576 scope.go:117] "RemoveContainer" containerID="d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" Jul 21 08:56:58.111632 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.111615 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d\": container with ID starting with d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d not found: ID does not exist" containerID="d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" Jul 21 08:56:58.111682 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.111641 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d"} err="failed to get container status \"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d\": rpc error: code = NotFound desc = could not find container \"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d\": container with ID starting with d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d not found: ID does not exist" Jul 21 08:56:58.111682 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.111660 2576 scope.go:117] "RemoveContainer" containerID="62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" Jul 21 08:56:58.111873 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.111855 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8\": container with ID starting with 62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8 not found: ID does not exist" containerID="62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" Jul 21 08:56:58.111944 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.111894 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8"} err="failed to get container status \"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8\": rpc error: code = NotFound desc = could not find container \"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8\": container with ID starting with 62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8 not found: ID does not exist" Jul 21 08:56:58.111944 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.111919 2576 scope.go:117] "RemoveContainer" containerID="a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" Jul 21 08:56:58.112188 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.112172 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e\": container with ID starting with a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e not found: ID does not exist" containerID="a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" Jul 21 08:56:58.112230 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112195 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e"} err="failed to get container status \"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e\": rpc error: code = NotFound desc = could not find container \"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e\": container with ID starting with a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e not found: ID does not exist" Jul 21 08:56:58.112230 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112208 2576 scope.go:117] "RemoveContainer" containerID="ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" Jul 21 08:56:58.112464 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.112448 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c\": container with ID starting with ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c not found: ID does not exist" containerID="ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" Jul 21 08:56:58.112507 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112469 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c"} err="failed to get container status \"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c\": rpc error: code = NotFound desc = could not find container \"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c\": container with ID starting with ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c not found: ID does not exist" Jul 21 08:56:58.112507 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112491 2576 scope.go:117] "RemoveContainer" containerID="08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" Jul 21 08:56:58.112735 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.112719 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79\": container with ID starting with 08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79 not found: ID does not exist" containerID="08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" Jul 21 08:56:58.112775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112738 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79"} err="failed to get container status \"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79\": rpc error: code = NotFound desc = could not find container \"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79\": container with ID starting with 08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79 not found: ID does not exist" Jul 21 08:56:58.112775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.112751 2576 scope.go:117] "RemoveContainer" containerID="30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" Jul 21 08:56:58.113016 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.112975 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687\": container with ID starting with 30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687 not found: ID does not exist" containerID="30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" Jul 21 08:56:58.113104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113018 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687"} err="failed to get container status \"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687\": rpc error: code = NotFound desc = could not find container \"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687\": container with ID starting with 30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687 not found: ID does not exist" Jul 21 08:56:58.113104 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113033 2576 scope.go:117] "RemoveContainer" containerID="4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0" Jul 21 08:56:58.113250 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:56:58.113235 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0\": container with ID starting with 4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0 not found: ID does not exist" containerID="4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0" Jul 21 08:56:58.113316 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113257 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0"} err="failed to get container status \"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0\": rpc error: code = NotFound desc = could not find container \"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0\": container with ID starting with 4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0 not found: ID does not exist" Jul 21 08:56:58.113316 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113277 2576 scope.go:117] "RemoveContainer" containerID="d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d" Jul 21 08:56:58.113502 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113485 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d"} err="failed to get container status \"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d\": rpc error: code = NotFound desc = could not find container \"d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d\": container with ID starting with d5ded4e7d57bf927af845836c3053a724baa7b17b5439b91ed14290b4b93bf3d not found: ID does not exist" Jul 21 08:56:58.113543 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113502 2576 scope.go:117] "RemoveContainer" containerID="62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8" Jul 21 08:56:58.113695 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113678 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8"} err="failed to get container status \"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8\": rpc error: code = NotFound desc = could not find container \"62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8\": container with ID starting with 62fff3f200ff3864d9b5cb33b0ab655e6176bfe7beb0b8ba7e35ebee96cec4a8 not found: ID does not exist" Jul 21 08:56:58.113761 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113697 2576 scope.go:117] "RemoveContainer" containerID="a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e" Jul 21 08:56:58.113903 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113882 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e"} err="failed to get container status \"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e\": rpc error: code = NotFound desc = could not find container \"a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e\": container with ID starting with a55071bae59e934e581958364e4e776df2f7cb659e85cf59c509d1d82c4eee5e not found: ID does not exist" Jul 21 08:56:58.113945 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.113904 2576 scope.go:117] "RemoveContainer" containerID="ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c" Jul 21 08:56:58.114135 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114117 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c"} err="failed to get container status \"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c\": rpc error: code = NotFound desc = could not find container \"ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c\": container with ID starting with ce418ee827b6281335cb21d5e330d05e81ddbcb2e79a4fb75d33fb9f3acab87c not found: ID does not exist" Jul 21 08:56:58.114188 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114136 2576 scope.go:117] "RemoveContainer" containerID="08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79" Jul 21 08:56:58.114327 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114312 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79"} err="failed to get container status \"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79\": rpc error: code = NotFound desc = could not find container \"08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79\": container with ID starting with 08d1605793f69476ea5dc7cc11135b8efdaff9a62a8baaf84c325e5a3d067e79 not found: ID does not exist" Jul 21 08:56:58.114368 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114328 2576 scope.go:117] "RemoveContainer" containerID="30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687" Jul 21 08:56:58.114517 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114499 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687"} err="failed to get container status \"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687\": rpc error: code = NotFound desc = could not find container \"30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687\": container with ID starting with 30623981b96d6139c6c004ad23bf2b10510c43b8c424188e4316f0ebd2c4b687 not found: ID does not exist" Jul 21 08:56:58.114566 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114517 2576 scope.go:117] "RemoveContainer" containerID="4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0" Jul 21 08:56:58.114759 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.114732 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0"} err="failed to get container status \"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0\": rpc error: code = NotFound desc = could not find container \"4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0\": container with ID starting with 4e985cc03d90c87c9e2f8d5e351790b26da1b5f813fcce88ba7defb0dbe40ab0 not found: ID does not exist" Jul 21 08:56:58.125775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.125754 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:58.126109 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126096 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126111 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126123 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="init-config-reloader" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126129 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="init-config-reloader" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126139 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-web" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126145 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-web" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126154 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2550adaf-4115-4b02-aaf5-d074a02a6987" containerName="console" Jul 21 08:56:58.126166 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126159 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2550adaf-4115-4b02-aaf5-d074a02a6987" containerName="console" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126169 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-metric" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126175 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-metric" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126181 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="config-reloader" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126199 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="config-reloader" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126205 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="prom-label-proxy" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126212 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="prom-label-proxy" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126221 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="alertmanager" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126226 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="alertmanager" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126269 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="alertmanager" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126277 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-web" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126283 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126289 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="config-reloader" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126295 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="kube-rbac-proxy-metric" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126301 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" containerName="prom-label-proxy" Jul 21 08:56:58.126392 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.126306 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2550adaf-4115-4b02-aaf5-d074a02a6987" containerName="console" Jul 21 08:56:58.129487 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.129472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.131806 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.131789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 08:56:58.131806 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.131814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 08:56:58.131806 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.131827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 08:56:58.132136 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.131827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 08:56:58.132136 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.131967 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 08:56:58.132297 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.132263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 08:56:58.132601 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.132575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 08:56:58.132685 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.132634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 08:56:58.132685 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.132663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x74tv\"" Jul 21 08:56:58.137776 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.137732 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 08:56:58.145465 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.145441 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:58.146594 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-web-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146737 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146996 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146996 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsf46\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-kube-api-access-bsf46\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.146996 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.146947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.147143 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.147019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.147143 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.147054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-config-out\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.147143 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.147101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.147143 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.147127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.196962 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.196928 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="809292f2-fe36-499f-b8d8-fe4dffe85068" path="/var/lib/kubelet/pods/809292f2-fe36-499f-b8d8-fe4dffe85068/volumes" Jul 21 08:56:58.248372 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-web-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248804 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsf46\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-kube-api-access-bsf46\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248804 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248804 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.248804 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-config-out\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.249035 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.249035 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.248836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.250351 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.249812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.250351 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.249914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199cdc15-a28e-4812-a130-21865cb957fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.250351 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.250120 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251499 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251595 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251639 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251606 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251639 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251708 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.251936 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.251918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-web-config\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.252188 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.252173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199cdc15-a28e-4812-a130-21865cb957fb-config-out\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.252685 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.252668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.253349 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.253333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199cdc15-a28e-4812-a130-21865cb957fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.258341 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.258324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsf46\" (UniqueName: \"kubernetes.io/projected/199cdc15-a28e-4812-a130-21865cb957fb-kube-api-access-bsf46\") pod \"alertmanager-main-0\" (UID: \"199cdc15-a28e-4812-a130-21865cb957fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.440862 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.440835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:58.577921 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:58.577886 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:58.581015 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:56:58.580970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199cdc15_a28e_4812_a130_21865cb957fb.slice/crio-6e55bbf0b71423bbd4cfb7b6b5fb4ef20ebe86737c45187b445afae5d0bf16d3 WatchSource:0}: Error finding container 6e55bbf0b71423bbd4cfb7b6b5fb4ef20ebe86737c45187b445afae5d0bf16d3: Status 404 returned error can't find the container with id 6e55bbf0b71423bbd4cfb7b6b5fb4ef20ebe86737c45187b445afae5d0bf16d3 Jul 21 08:56:59.066799 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:59.066762 2576 generic.go:356] "Generic (PLEG): container finished" podID="199cdc15-a28e-4812-a130-21865cb957fb" containerID="84bf3dbb5eb1b3312690df4fed31523dfc9c588cd4934f3362545d4a452f9ae6" exitCode=0 Jul 21 08:56:59.067282 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:59.066854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerDied","Data":"84bf3dbb5eb1b3312690df4fed31523dfc9c588cd4934f3362545d4a452f9ae6"} Jul 21 08:56:59.067282 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:56:59.067005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"6e55bbf0b71423bbd4cfb7b6b5fb4ef20ebe86737c45187b445afae5d0bf16d3"} Jul 21 08:57:00.075345 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"df11d040bda3e33bf80a9d924a93e1bf9ec945f7f7a8085290e7dececc9e381e"} Jul 21 08:57:00.075716 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"592e9f60f5f626135d9421c5c207801cc5877843113444d240fe6df70e9f4a3a"} Jul 21 08:57:00.075716 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"8c64ce32fbc051f644b8be5982ded2e2ed6e62e40c9a66548fe84be6314a3245"} Jul 21 08:57:00.075716 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"1225eff27bd61ae8f10ee7e6a64d603d999a4cde190e555b71c080b7dda3620e"} Jul 21 08:57:00.075716 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"dd4fdf5bd93039510782936db1837cb2e1cdf4e0f386f577a0ee46f1e33a05d3"} Jul 21 08:57:00.075716 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.075471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199cdc15-a28e-4812-a130-21865cb957fb","Type":"ContainerStarted","Data":"9b107bf1bfc3851d2991d05c94646749c8b22f9ef3f760a5c6dae05d44b71104"} Jul 21 08:57:00.100831 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.100783 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.085548649 podStartE2EDuration="2.100763223s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.214574ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:56:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:57:00.099118258 +0000 UTC m=+154.452449481" watchObservedRunningTime="2026-07-21 08:57:00.100763223 +0000 UTC m=+154.454094444" Jul 21 08:57:00.653460 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653425 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:00.653775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653739 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="prometheus" containerID="cri-o://60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" gracePeriod=600 Jul 21 08:57:00.653775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653757 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy" containerID="cri-o://42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" gracePeriod=600 Jul 21 08:57:00.654006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653776 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-web" containerID="cri-o://7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" gracePeriod=600 Jul 21 08:57:00.654006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653813 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="config-reloader" containerID="cri-o://d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" gracePeriod=600 Jul 21 08:57:00.654006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653759 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="thanos-sidecar" containerID="cri-o://ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" gracePeriod=600 Jul 21 08:57:00.654006 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.653809 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" gracePeriod=600 Jul 21 08:57:00.911547 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.911475 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:00.973055 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973219 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973065 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973219 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973090 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973219 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973140 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973219 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973172 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973219 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973200 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973351 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmwx6\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.973531 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973511 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973537 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973577 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973608 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.973663 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\" (UID: \"ba12d2d8-0df7-44d0-a28f-1f0f3be56123\") " Jul 21 08:57:00.974282 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.974154 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:57:00.974921 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.974386 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.974921 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.974683 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.975168 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.975138 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.976003 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.975964 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.976485 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.976233 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.976596 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.976536 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.976842 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.976821 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:57:00.981357 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.981326 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out" (OuterVolumeSpecName: "config-out") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:57:00.981590 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.981549 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.981818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.981778 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.981818 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.981801 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6" (OuterVolumeSpecName: "kube-api-access-mmwx6") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "kube-api-access-mmwx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:57:00.981971 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.981949 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:57:00.982058 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982035 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.982222 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982188 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.982369 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982343 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config" (OuterVolumeSpecName: "config") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.982479 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982435 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.982541 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982510 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.982822 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.982797 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:00.991497 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:00.991469 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config" (OuterVolumeSpecName: "web-config") pod "ba12d2d8-0df7-44d0-a28f-1f0f3be56123" (UID: "ba12d2d8-0df7-44d0-a28f-1f0f3be56123"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:57:01.074619 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074585 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074619 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074613 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-kube-rbac-proxy\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074619 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074623 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074634 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-tls-assets\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074643 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmwx6\" (UniqueName: \"kubernetes.io/projected/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-kube-api-access-mmwx6\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074651 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074660 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074669 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-metrics-client-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074677 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074685 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074695 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074703 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074713 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-config-out\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074721 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-k8s-db\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074731 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074741 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074749 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074758 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-grpc-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074765 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-web-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.074839 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.074773 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba12d2d8-0df7-44d0-a28f-1f0f3be56123-secret-metrics-client-certs\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:57:01.082521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082491 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" exitCode=0 Jul 21 08:57:01.082521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082513 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" exitCode=0 Jul 21 08:57:01.082521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082519 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" exitCode=0 Jul 21 08:57:01.082521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082525 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" exitCode=0 Jul 21 08:57:01.082521 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082530 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" exitCode=0 Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082536 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" exitCode=0 Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082564 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082714 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.082767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} Jul 21 08:57:01.083046 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} Jul 21 08:57:01.083046 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.082825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba12d2d8-0df7-44d0-a28f-1f0f3be56123","Type":"ContainerDied","Data":"c7e636fbdcb553ab2110c0004ef5df8277a247c6007eb12db2fdc15fedf23fca"} Jul 21 08:57:01.093709 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.093683 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.100950 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.100933 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.108039 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.108017 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.109125 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.109103 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:01.112704 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.112681 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:01.115471 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.115447 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.122087 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.122065 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.128858 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.128844 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.135561 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.135543 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.135807 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.135787 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.135854 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.135814 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.135854 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.135834 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.136087 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.136070 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.136140 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136093 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.136140 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136109 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.136323 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.136307 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.136362 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136327 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.136362 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136341 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.136534 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.136516 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.136599 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136542 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.136599 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136563 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.136796 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.136775 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.136833 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136803 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.136833 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.136817 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.137035 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.137019 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.137098 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137037 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.137098 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137049 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.137250 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:57:01.137230 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.137293 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137257 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.137293 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137276 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.137513 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137498 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.137552 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137514 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.137706 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137691 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.137749 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137705 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.137879 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137865 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.137920 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.137879 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.138122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.138104 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.138171 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.138122 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.138349 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.138332 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.138436 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.138350 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.139258 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139218 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.139407 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139272 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.139680 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139658 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.139680 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139680 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.139890 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139870 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.139890 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.139890 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.140131 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140111 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.140131 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140130 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.140401 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140381 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.140401 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140400 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.140612 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140419 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:01.140656 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140623 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.140656 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140639 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.140745 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140732 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="prometheus" Jul 21 08:57:01.140783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140746 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="prometheus" Jul 21 08:57:01.140783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="config-reloader" Jul 21 08:57:01.140783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140766 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="config-reloader" Jul 21 08:57:01.140783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140776 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="thanos-sidecar" Jul 21 08:57:01.140783 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140781 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="thanos-sidecar" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140789 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="init-config-reloader" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140797 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="init-config-reloader" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-web" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140820 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-web" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140828 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-thanos" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140834 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-thanos" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140842 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140847 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140845 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140862 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140898 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="thanos-sidecar" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140905 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="prometheus" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140917 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-thanos" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140922 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="config-reloader" Jul 21 08:57:01.140949 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.140927 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" containerName="kube-rbac-proxy-web" Jul 21 08:57:01.141572 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.141572 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141154 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.141572 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141372 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.141572 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141389 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.141699 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.141699 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141601 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.141832 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141806 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.141873 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.141835 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.142064 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142049 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.142109 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142065 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.142265 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142248 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.142316 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142266 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.142491 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142472 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.142526 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142492 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.142710 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142690 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.142782 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142712 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.142934 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142917 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.142993 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.142934 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.143163 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.143163 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143159 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.143360 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143342 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.143403 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143360 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.143567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143533 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.143567 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143549 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.143761 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143743 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.143811 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.143763 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.144095 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144025 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.144095 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144060 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.144468 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144443 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.144528 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144470 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.144763 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144732 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.144763 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144759 2576 scope.go:117] "RemoveContainer" containerID="d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56" Jul 21 08:57:01.144926 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.144833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.145059 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145038 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56"} err="failed to get container status \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": rpc error: code = NotFound desc = could not find container \"d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56\": container with ID starting with d9fc67aaae5a45b830413613565f1f57f93d8bb1ab99010a997fd4d838ecbd56 not found: ID does not exist" Jul 21 08:57:01.145137 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145061 2576 scope.go:117] "RemoveContainer" containerID="42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a" Jul 21 08:57:01.145580 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145559 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a"} err="failed to get container status \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": rpc error: code = NotFound desc = could not find container \"42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a\": container with ID starting with 42f0234fc94df82c8049b0d0c7a1a7ec3d25bf6eb4ae28a17cd7c48b865eb94a not found: ID does not exist" Jul 21 08:57:01.145688 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145603 2576 scope.go:117] "RemoveContainer" containerID="7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f" Jul 21 08:57:01.145882 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145818 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f"} err="failed to get container status \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": rpc error: code = NotFound desc = could not find container \"7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f\": container with ID starting with 7bf493bbcce4608deaa54c25ef1474cc0a36bedec6b55b383f73e12bac81497f not found: ID does not exist" Jul 21 08:57:01.145882 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.145854 2576 scope.go:117] "RemoveContainer" containerID="ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671" Jul 21 08:57:01.146122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146103 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671"} err="failed to get container status \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": rpc error: code = NotFound desc = could not find container \"ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671\": container with ID starting with ad4a52f67c0688c18bc6faa100aba87331f275f7e36c7349e8647680647eb671 not found: ID does not exist" Jul 21 08:57:01.146122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146122 2576 scope.go:117] "RemoveContainer" containerID="d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1" Jul 21 08:57:01.146404 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146389 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1"} err="failed to get container status \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": rpc error: code = NotFound desc = could not find container \"d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1\": container with ID starting with d38fed9211fbb49231fd9135f56c30c86ffd92a4151549be915d2964d2cb86d1 not found: ID does not exist" Jul 21 08:57:01.146445 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146405 2576 scope.go:117] "RemoveContainer" containerID="60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b" Jul 21 08:57:01.146711 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146682 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b"} err="failed to get container status \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": rpc error: code = NotFound desc = could not find container \"60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b\": container with ID starting with 60bda1074eec342379d186a47e9a15363a355eb2d90db25ff85670862e0d342b not found: ID does not exist" Jul 21 08:57:01.146711 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146709 2576 scope.go:117] "RemoveContainer" containerID="52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced" Jul 21 08:57:01.146971 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.146953 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced"} err="failed to get container status \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": rpc error: code = NotFound desc = could not find container \"52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced\": container with ID starting with 52a4f4cd7880b46e44b63034b545ead37209d72f47a3f238f374d5de72cc8ced not found: ID does not exist" Jul 21 08:57:01.147252 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147225 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 08:57:01.147252 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 08:57:01.147371 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147334 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-89qfm\"" Jul 21 08:57:01.147371 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147353 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 08:57:01.147472 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147371 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 08:57:01.147472 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147423 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-avnui3b3oh4h3\"" Jul 21 08:57:01.147719 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 08:57:01.147786 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.147739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 08:57:01.148098 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.148046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 08:57:01.148343 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.148204 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 08:57:01.148343 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.148231 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 08:57:01.148343 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.148270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 08:57:01.148343 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.148278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 08:57:01.149291 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.149276 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 08:57:01.150470 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.150451 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 08:57:01.154532 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.154516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 08:57:01.160681 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.159647 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:01.175467 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175467 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175467 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175697 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175697 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175806 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175851 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.175937 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.175919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176017 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176054 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176054 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176195 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176297 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cblf6\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-kube-api-access-cblf6\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176355 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176539 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176574 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176574 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.176683 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.176593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.277912 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.277877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.277912 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.277913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278165 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.277933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278165 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278276 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278276 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278276 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cblf6\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-kube-api-access-cblf6\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.278276 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278805 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279020 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.279784 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.280784 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.280749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281021 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.280977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281128 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.281047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281128 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.278805 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281885 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.281420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281885 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.281564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281885 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.281654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.281885 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.281780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.282147 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.282119 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.282289 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.282267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.282478 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.282453 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.283135 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.283115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.283368 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.283350 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.283444 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.283403 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.284234 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.284208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.284744 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.284725 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.286059 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.286043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cblf6\" (UniqueName: \"kubernetes.io/projected/cac5f9fb-4090-46e4-86b2-fca4a8fec64a-kube-api-access-cblf6\") pod \"prometheus-k8s-0\" (UID: \"cac5f9fb-4090-46e4-86b2-fca4a8fec64a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.455181 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.455094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:01.589850 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:01.589793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:57:01.592716 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:57:01.592686 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac5f9fb_4090_46e4_86b2_fca4a8fec64a.slice/crio-9fca5a3de7eb51f03432316973aa985cfb3d367a14a49ca1b8176ab3c3f91852 WatchSource:0}: Error finding container 9fca5a3de7eb51f03432316973aa985cfb3d367a14a49ca1b8176ab3c3f91852: Status 404 returned error can't find the container with id 9fca5a3de7eb51f03432316973aa985cfb3d367a14a49ca1b8176ab3c3f91852 Jul 21 08:57:02.088176 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:02.088140 2576 generic.go:356] "Generic (PLEG): container finished" podID="cac5f9fb-4090-46e4-86b2-fca4a8fec64a" containerID="94eeff961945403e9fc35cfc993d6441a5a1aa3e59544ba44adec972b87f50dc" exitCode=0 Jul 21 08:57:02.088612 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:02.088239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerDied","Data":"94eeff961945403e9fc35cfc993d6441a5a1aa3e59544ba44adec972b87f50dc"} Jul 21 08:57:02.088612 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:02.088307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"9fca5a3de7eb51f03432316973aa985cfb3d367a14a49ca1b8176ab3c3f91852"} Jul 21 08:57:02.200754 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:02.199672 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba12d2d8-0df7-44d0-a28f-1f0f3be56123" path="/var/lib/kubelet/pods/ba12d2d8-0df7-44d0-a28f-1f0f3be56123/volumes" Jul 21 08:57:03.096056 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"d0325193113fea126a69610eb4f7d8d7a7fa6a91a86b6ecf32fb101e9e4029bf"} Jul 21 08:57:03.096432 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"878a83d0863eca4d0d3d4f9d811d64189e0f86c57fa45c15e3080296f86f2213"} Jul 21 08:57:03.096432 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"8da8d3901c55fa264eed61711c97f7f50c8b93ccce2b4bc0fc80c7b682aa7de3"} Jul 21 08:57:03.096432 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"8c80efbe22f99db2d80a049065153087445aaa9db84ae8b50740fe8437d76a41"} Jul 21 08:57:03.096432 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"82190b9951cfea53d57e7c65b8889f7b26c9bff1caf4bee90f5cfd23e2be88e3"} Jul 21 08:57:03.096432 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.096189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cac5f9fb-4090-46e4-86b2-fca4a8fec64a","Type":"ContainerStarted","Data":"5dbcbef66f8a399702e393a3ecffb083aa897ca79b1fe437a2ff7a1992d3b465"} Jul 21 08:57:03.123768 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:03.123715 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.10149334 podStartE2EDuration="2.123697747s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.204407ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:57:03.120578287 +0000 UTC m=+157.473909511" watchObservedRunningTime="2026-07-21 08:57:03.123697747 +0000 UTC m=+157.477028968" Jul 21 08:57:05.274637 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.274603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:57:05.276846 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.276826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.279051 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.279028 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 08:57:05.279171 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.279127 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 08:57:05.280114 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.280085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 08:57:05.280205 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.280124 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 08:57:05.280689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.280393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-96f2k\"" Jul 21 08:57:05.280689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.280468 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 08:57:05.288217 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.288134 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 08:57:05.288670 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.288638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:57:05.315022 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.314959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315182 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315182 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315182 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315385 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315385 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dzm2\" (UniqueName: \"kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.315385 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.315320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.331969 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.331937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:05.415977 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.415927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.415977 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.415992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dzm2\" (UniqueName: \"kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.416248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.416026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.416248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.416067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.416248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.416131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.416248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.416176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.416248 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.416216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.417049 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.417019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.417197 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.417092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.417197 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.417094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.417197 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.417104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.418584 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.418564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.418681 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.418588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.426306 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.426285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dzm2\" (UniqueName: \"kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2\") pod \"console-5647bcd8cc-tj6jv\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.434767 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.434738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:05.538706 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.538580 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:05.592320 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.592287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:05.734410 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:05.734375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:57:05.739392 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:57:05.739363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e943712_5fa3_491b_a880_cd095284d116.slice/crio-e7cab5021aef5a552c30fc99b63853b2f9398ba9f3233f9aee586c810976e549 WatchSource:0}: Error finding container e7cab5021aef5a552c30fc99b63853b2f9398ba9f3233f9aee586c810976e549: Status 404 returned error can't find the container with id e7cab5021aef5a552c30fc99b63853b2f9398ba9f3233f9aee586c810976e549 Jul 21 08:57:06.091940 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.091903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:06.110360 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.110326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647bcd8cc-tj6jv" event={"ID":"5e943712-5fa3-491b-a880-cd095284d116","Type":"ContainerStarted","Data":"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7"} Jul 21 08:57:06.110519 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.110377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647bcd8cc-tj6jv" event={"ID":"5e943712-5fa3-491b-a880-cd095284d116","Type":"ContainerStarted","Data":"e7cab5021aef5a552c30fc99b63853b2f9398ba9f3233f9aee586c810976e549"} Jul 21 08:57:06.137131 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.137076 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5647bcd8cc-tj6jv" podStartSLOduration=1.137060264 podStartE2EDuration="1.137060264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:57:06.136066071 +0000 UTC m=+160.489397292" watchObservedRunningTime="2026-07-21 08:57:06.137060264 +0000 UTC m=+160.490391486" Jul 21 08:57:06.275665 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.275616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:06.456264 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:06.456184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:15.592607 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:15.592565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:15.593035 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:15.592631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:15.597315 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:15.597289 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:16.158552 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:16.158525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:57:16.323149 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:16.323116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:16.424834 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:16.424740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:16.500453 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:16.500419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:34.457452 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:34.457420 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:34.526734 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:34.526698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:57:44.638290 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:57:44.638249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:01.456154 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:01.456113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:58:01.471586 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:01.471557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:58:02.353743 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:02.353702 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:58:10.538089 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:10.538053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:10.605092 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:10.605060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:13.184976 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:13.184939 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:22.453402 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:22.453351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:22.506600 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:22.506569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:23.855738 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:23.855704 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:58:23.962163 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:23.962132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:24.063075 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:24.063044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:29.015478 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:29.015443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:29.116530 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:29.116500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:58:48.875624 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:48.875527 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5647bcd8cc-tj6jv" podUID="5e943712-5fa3-491b-a880-cd095284d116" containerName="console" containerID="cri-o://dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7" gracePeriod=15 Jul 21 08:58:49.109323 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.109290 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:58:49.198644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198560 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198616 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198644 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198639 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198938 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198701 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198938 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dzm2\" (UniqueName: \"kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.198938 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198920 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config\") pod \"5e943712-5fa3-491b-a880-cd095284d116\" (UID: \"5e943712-5fa3-491b-a880-cd095284d116\") " Jul 21 08:58:49.199130 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.198977 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:58:49.199130 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199072 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:58:49.199130 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199092 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:58:49.199288 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199202 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-trusted-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.199288 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199214 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-service-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.199403 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199318 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-oauth-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.199486 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.199463 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config" (OuterVolumeSpecName: "console-config") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:58:49.200903 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.200877 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:58:49.201041 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.200929 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:58:49.201041 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.201019 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2" (OuterVolumeSpecName: "kube-api-access-4dzm2") pod "5e943712-5fa3-491b-a880-cd095284d116" (UID: "5e943712-5fa3-491b-a880-cd095284d116"). InnerVolumeSpecName "kube-api-access-4dzm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:58:49.299673 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.299636 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-oauth-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.299673 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.299667 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e943712-5fa3-491b-a880-cd095284d116-console-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.299931 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.299684 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dzm2\" (UniqueName: \"kubernetes.io/projected/5e943712-5fa3-491b-a880-cd095284d116-kube-api-access-4dzm2\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.299931 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.299697 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e943712-5fa3-491b-a880-cd095284d116-console-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 08:58:49.523139 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.523050 2576 generic.go:356] "Generic (PLEG): container finished" podID="5e943712-5fa3-491b-a880-cd095284d116" containerID="dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7" exitCode=0 Jul 21 08:58:49.523139 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.523100 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647bcd8cc-tj6jv" Jul 21 08:58:49.523139 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.523130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647bcd8cc-tj6jv" event={"ID":"5e943712-5fa3-491b-a880-cd095284d116","Type":"ContainerDied","Data":"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7"} Jul 21 08:58:49.523360 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.523182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647bcd8cc-tj6jv" event={"ID":"5e943712-5fa3-491b-a880-cd095284d116","Type":"ContainerDied","Data":"e7cab5021aef5a552c30fc99b63853b2f9398ba9f3233f9aee586c810976e549"} Jul 21 08:58:49.523360 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.523203 2576 scope.go:117] "RemoveContainer" containerID="dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7" Jul 21 08:58:49.533258 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.533113 2576 scope.go:117] "RemoveContainer" containerID="dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7" Jul 21 08:58:49.533806 ip-10-0-128-156 kubenswrapper[2576]: E0721 08:58:49.533776 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7\": container with ID starting with dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7 not found: ID does not exist" containerID="dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7" Jul 21 08:58:49.533910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.533815 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7"} err="failed to get container status \"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7\": rpc error: code = NotFound desc = could not find container \"dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7\": container with ID starting with dd2702fc6fd228fcdc983d3766617257959e060bab9ff0b0e3884ab6a0fa65f7 not found: ID does not exist" Jul 21 08:58:49.542793 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.542768 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:58:49.548298 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:49.548272 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5647bcd8cc-tj6jv"] Jul 21 08:58:50.196504 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:58:50.196472 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e943712-5fa3-491b-a880-cd095284d116" path="/var/lib/kubelet/pods/5e943712-5fa3-491b-a880-cd095284d116/volumes" Jul 21 08:59:00.031863 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:00.031824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:00.132829 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:00.132796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:21.903099 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:21.903065 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:24.436056 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:24.436023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:26.041856 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:26.041825 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 08:59:26.393669 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:26.393631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:26.498122 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:26.498090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:27.030156 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.030118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:27.126854 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.126823 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:27.133598 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.133567 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v6b42"] Jul 21 08:59:27.133910 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.133898 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e943712-5fa3-491b-a880-cd095284d116" containerName="console" Jul 21 08:59:27.133952 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.133913 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e943712-5fa3-491b-a880-cd095284d116" containerName="console" Jul 21 08:59:27.134032 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.133968 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e943712-5fa3-491b-a880-cd095284d116" containerName="console" Jul 21 08:59:27.136801 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.136780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.139819 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.139797 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 08:59:27.140198 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.140182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 08:59:27.150391 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.150366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v6b42"] Jul 21 08:59:27.227596 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.227553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.227775 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.227612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvxm\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-kube-api-access-tfvxm\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.328476 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.328445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvxm\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-kube-api-access-tfvxm\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.328639 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.328513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.337495 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.337463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.337618 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.337542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvxm\" (UniqueName: \"kubernetes.io/projected/d7435f16-d049-48cd-b5e6-13d29c8abde9-kube-api-access-tfvxm\") pod \"cert-manager-webhook-6486ffd997-v6b42\" (UID: \"d7435f16-d049-48cd-b5e6-13d29c8abde9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.458830 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.458796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:27.605524 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.605448 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v6b42"] Jul 21 08:59:27.608804 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:59:27.608770 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7435f16_d049_48cd_b5e6_13d29c8abde9.slice/crio-10f85499cb1a7e0937ea7ea3e611b4506d487ffbbaf0943bc281ca41cefc9b96 WatchSource:0}: Error finding container 10f85499cb1a7e0937ea7ea3e611b4506d487ffbbaf0943bc281ca41cefc9b96: Status 404 returned error can't find the container with id 10f85499cb1a7e0937ea7ea3e611b4506d487ffbbaf0943bc281ca41cefc9b96 Jul 21 08:59:27.610689 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.610670 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 08:59:27.679761 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:27.679723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" event={"ID":"d7435f16-d049-48cd-b5e6-13d29c8abde9","Type":"ContainerStarted","Data":"10f85499cb1a7e0937ea7ea3e611b4506d487ffbbaf0943bc281ca41cefc9b96"} Jul 21 08:59:29.019266 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.019226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:29.296726 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.296649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf"] Jul 21 08:59:29.302314 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.302285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.304442 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.304380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hk8hb\"" Jul 21 08:59:29.309651 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.309628 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf"] Jul 21 08:59:29.349167 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.349133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghrpd\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-kube-api-access-ghrpd\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.349355 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.349292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.444438 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.444407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:29.450539 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.450511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.450672 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.450565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghrpd\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-kube-api-access-ghrpd\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.470358 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.470326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghrpd\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-kube-api-access-ghrpd\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.472495 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.472468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75aaf849-9ccf-443e-8e3d-18daec0f59fe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z2jdf\" (UID: \"75aaf849-9ccf-443e-8e3d-18daec0f59fe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:29.613926 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:29.613891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" Jul 21 08:59:30.304542 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.304495 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:30.404695 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.404662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:30.478053 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.477907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf"] Jul 21 08:59:30.480659 ip-10-0-128-156 kubenswrapper[2576]: W0721 08:59:30.480631 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75aaf849_9ccf_443e_8e3d_18daec0f59fe.slice/crio-fb493acc026a4cf60644686894add142103a0bfb5ebe224c83c8b7418a4e36ba WatchSource:0}: Error finding container fb493acc026a4cf60644686894add142103a0bfb5ebe224c83c8b7418a4e36ba: Status 404 returned error can't find the container with id fb493acc026a4cf60644686894add142103a0bfb5ebe224c83c8b7418a4e36ba Jul 21 08:59:30.696053 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.696022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" event={"ID":"75aaf849-9ccf-443e-8e3d-18daec0f59fe","Type":"ContainerStarted","Data":"317d5c1ff6aa24b27fce9a6cd1509053ab165483cf83282beec55c99f579af1f"} Jul 21 08:59:30.696245 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.696061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" event={"ID":"75aaf849-9ccf-443e-8e3d-18daec0f59fe","Type":"ContainerStarted","Data":"fb493acc026a4cf60644686894add142103a0bfb5ebe224c83c8b7418a4e36ba"} Jul 21 08:59:30.697782 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.697753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" event={"ID":"d7435f16-d049-48cd-b5e6-13d29c8abde9","Type":"ContainerStarted","Data":"79df272021ebca11a2dea5150694355086a93b702f10bc5a5fbd48efdfc6025a"} Jul 21 08:59:30.697901 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.697831 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:30.723243 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.723180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z2jdf" podStartSLOduration=1.72316106 podStartE2EDuration="1.72316106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:59:30.721953655 +0000 UTC m=+305.075284881" watchObservedRunningTime="2026-07-21 08:59:30.72316106 +0000 UTC m=+305.076492282" Jul 21 08:59:30.742330 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:30.741593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" podStartSLOduration=0.931351901 podStartE2EDuration="3.741572329s" totalImagesPullingTime="2.810220428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:59:30.740803425 +0000 UTC m=+305.094134661" watchObservedRunningTime="2026-07-21 08:59:30.741572329 +0000 UTC m=+305.094903578" Jul 21 08:59:36.703925 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:36.703891 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v6b42" Jul 21 08:59:37.830184 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:37.830149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:42.808054 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:42.808022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:42.918157 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:42.918109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:50.973470 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:50.973437 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:51.067825 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:51.067792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:55.895297 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:55.895245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 08:59:58.231041 ip-10-0-128-156 kubenswrapper[2576]: I0721 08:59:58.231009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:00:00.811116 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:00:00.811079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:00:00.913385 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:00:00.913351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:00:11.854497 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:00:11.854459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:00:11.919249 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:00:11.919215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:20.870411 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:20.870380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:20.971696 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:20.971663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:21.046258 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:21.046224 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:31.955345 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:31.955278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:32.056136 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:32.056100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:33.922223 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:33.922190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:33.979094 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:33.979059 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:35.440123 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:35.440086 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:37.727659 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:37.727622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:37.829587 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:37.829549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:50.222839 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:50.222758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:01:50.306468 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:01:50.306438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:15.225176 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:15.225135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:15.282063 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:15.282032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:15.925043 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:15.925008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:16.027347 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:16.027318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:18.094462 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.094424 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:02:18.097813 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.097790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.099938 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.099910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 21 09:02:18.100304 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.100280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:18.100594 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.100572 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 09:02:18.100701 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.100574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 21 09:02:18.100701 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.100617 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 09:02:18.100820 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.100797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-d44l4\"" Jul 21 09:02:18.105912 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.105884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:02:18.187747 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.187720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.187909 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.187766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.187909 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.187849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knh2\" (UniqueName: \"kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.284160 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.284115 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:18.288962 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.288939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.289090 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.289020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.289090 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.289073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7knh2\" (UniqueName: \"kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.289690 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.289669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.291243 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.291222 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.296930 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.296908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knh2\" (UniqueName: \"kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.407893 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.407790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:18.536264 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:18.536231 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:02:19.368170 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:19.368128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" event={"ID":"e2fbdce2-0aec-4435-a834-d401b09697c8","Type":"ContainerStarted","Data":"ca110a42b8b1efe45d7c99a20cf1e2208aa987fc85869d63df485d83f54c8af4"} Jul 21 09:02:23.391220 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:23.391178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" event={"ID":"e2fbdce2-0aec-4435-a834-d401b09697c8","Type":"ContainerStarted","Data":"d1a65752b2a32739020ce5224ee5c74b3e8bec059d06613bc7f5ab36afda34ad"} Jul 21 09:02:23.391612 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:23.391320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:23.405687 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:23.405631 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" podStartSLOduration=1.193652955 podStartE2EDuration="5.405615991s" totalImagesPullingTime="4.211963036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 09:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:02:23.403795117 +0000 UTC m=+477.757126336" watchObservedRunningTime="2026-07-21 09:02:23.405615991 +0000 UTC m=+477.758947228" Jul 21 09:02:23.477326 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:23.477294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:25.564177 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:25.564142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:36.088198 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:36.088157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:36.139419 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:36.139388 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:36.201049 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:36.201020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:02:39.399175 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:39.399142 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:02:42.123877 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:02:42.123845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:28.509833 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:28.509737 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:56.471113 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.471084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:56.654803 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.654763 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:03:56.655046 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.655000 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" podUID="e2fbdce2-0aec-4435-a834-d401b09697c8" containerName="manager" containerID="cri-o://d1a65752b2a32739020ce5224ee5c74b3e8bec059d06613bc7f5ab36afda34ad" gracePeriod=30 Jul 21 09:03:56.703405 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.703376 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:56.778933 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.778906 2576 generic.go:356] "Generic (PLEG): container finished" podID="e2fbdce2-0aec-4435-a834-d401b09697c8" containerID="d1a65752b2a32739020ce5224ee5c74b3e8bec059d06613bc7f5ab36afda34ad" exitCode=0 Jul 21 09:03:56.779082 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.778945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" event={"ID":"e2fbdce2-0aec-4435-a834-d401b09697c8","Type":"ContainerDied","Data":"d1a65752b2a32739020ce5224ee5c74b3e8bec059d06613bc7f5ab36afda34ad"} Jul 21 09:03:56.851683 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.851641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:56.908243 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.908217 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:03:56.963765 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:56.963736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:57.005576 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.005543 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert\") pod \"e2fbdce2-0aec-4435-a834-d401b09697c8\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " Jul 21 09:03:57.005775 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.005587 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config\") pod \"e2fbdce2-0aec-4435-a834-d401b09697c8\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " Jul 21 09:03:57.005775 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.005648 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7knh2\" (UniqueName: \"kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2\") pod \"e2fbdce2-0aec-4435-a834-d401b09697c8\" (UID: \"e2fbdce2-0aec-4435-a834-d401b09697c8\") " Jul 21 09:03:57.007789 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.007751 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2" (OuterVolumeSpecName: "kube-api-access-7knh2") pod "e2fbdce2-0aec-4435-a834-d401b09697c8" (UID: "e2fbdce2-0aec-4435-a834-d401b09697c8"). InnerVolumeSpecName "kube-api-access-7knh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 09:03:57.007905 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.007825 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert" (OuterVolumeSpecName: "cert") pod "e2fbdce2-0aec-4435-a834-d401b09697c8" (UID: "e2fbdce2-0aec-4435-a834-d401b09697c8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 09:03:57.010082 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.010063 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "e2fbdce2-0aec-4435-a834-d401b09697c8" (UID: "e2fbdce2-0aec-4435-a834-d401b09697c8"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 09:03:57.032440 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.032356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:03:57.106660 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.106623 2576 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2fbdce2-0aec-4435-a834-d401b09697c8-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 09:03:57.106660 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.106654 2576 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e2fbdce2-0aec-4435-a834-d401b09697c8-kubeflow-trainer-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 09:03:57.106660 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.106664 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7knh2\" (UniqueName: \"kubernetes.io/projected/e2fbdce2-0aec-4435-a834-d401b09697c8-kube-api-access-7knh2\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 21 09:03:57.784519 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.784484 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" Jul 21 09:03:57.784909 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.784536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br" event={"ID":"e2fbdce2-0aec-4435-a834-d401b09697c8","Type":"ContainerDied","Data":"ca110a42b8b1efe45d7c99a20cf1e2208aa987fc85869d63df485d83f54c8af4"} Jul 21 09:03:57.784909 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.784587 2576 scope.go:117] "RemoveContainer" containerID="d1a65752b2a32739020ce5224ee5c74b3e8bec059d06613bc7f5ab36afda34ad" Jul 21 09:03:57.806876 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.806853 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:03:57.812460 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:57.812433 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-fr4br"] Jul 21 09:03:58.196806 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:03:58.196777 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2fbdce2-0aec-4435-a834-d401b09697c8" path="/var/lib/kubelet/pods/e2fbdce2-0aec-4435-a834-d401b09697c8/volumes" Jul 21 09:04:42.273640 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:42.273599 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:43.710257 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:43.710221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:52.398147 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.398062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:52.533116 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.533076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5xdqm/must-gather-5494d"] Jul 21 09:04:52.533485 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.533468 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fbdce2-0aec-4435-a834-d401b09697c8" containerName="manager" Jul 21 09:04:52.533571 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.533487 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fbdce2-0aec-4435-a834-d401b09697c8" containerName="manager" Jul 21 09:04:52.533632 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.533578 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fbdce2-0aec-4435-a834-d401b09697c8" containerName="manager" Jul 21 09:04:52.536474 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.536452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.538474 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.538452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5xdqm\"/\"openshift-service-ca.crt\"" Jul 21 09:04:52.538728 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.538712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5xdqm\"/\"kube-root-ca.crt\"" Jul 21 09:04:52.539043 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.539029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5xdqm\"/\"default-dockercfg-jp9wm\"" Jul 21 09:04:52.544613 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.544585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5xdqm/must-gather-5494d"] Jul 21 09:04:52.573634 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.573602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f056744-4cb2-42e3-9b28-3457e5e7f59f-must-gather-output\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.573780 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.573665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfmk\" (UniqueName: \"kubernetes.io/projected/7f056744-4cb2-42e3-9b28-3457e5e7f59f-kube-api-access-ntfmk\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.616889 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.616859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:52.674364 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.674289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfmk\" (UniqueName: \"kubernetes.io/projected/7f056744-4cb2-42e3-9b28-3457e5e7f59f-kube-api-access-ntfmk\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.674364 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.674349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f056744-4cb2-42e3-9b28-3457e5e7f59f-must-gather-output\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.674655 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.674639 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f056744-4cb2-42e3-9b28-3457e5e7f59f-must-gather-output\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.677899 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.677874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:52.682647 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.682624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfmk\" (UniqueName: \"kubernetes.io/projected/7f056744-4cb2-42e3-9b28-3457e5e7f59f-kube-api-access-ntfmk\") pod \"must-gather-5494d\" (UID: \"7f056744-4cb2-42e3-9b28-3457e5e7f59f\") " pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.846379 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.846338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5xdqm/must-gather-5494d" Jul 21 09:04:52.981014 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.980463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5xdqm/must-gather-5494d"] Jul 21 09:04:52.987261 ip-10-0-128-156 kubenswrapper[2576]: W0721 09:04:52.987235 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f056744_4cb2_42e3_9b28_3457e5e7f59f.slice/crio-96e03b722863b81569f6f8df2cf07ab6d018591982fd620bc7a95b3335aec9bc WatchSource:0}: Error finding container 96e03b722863b81569f6f8df2cf07ab6d018591982fd620bc7a95b3335aec9bc: Status 404 returned error can't find the container with id 96e03b722863b81569f6f8df2cf07ab6d018591982fd620bc7a95b3335aec9bc Jul 21 09:04:52.988880 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:52.988865 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 09:04:53.008051 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:53.008024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5xdqm/must-gather-5494d" event={"ID":"7f056744-4cb2-42e3-9b28-3457e5e7f59f","Type":"ContainerStarted","Data":"96e03b722863b81569f6f8df2cf07ab6d018591982fd620bc7a95b3335aec9bc"} Jul 21 09:04:54.015823 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:54.015697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5xdqm/must-gather-5494d" event={"ID":"7f056744-4cb2-42e3-9b28-3457e5e7f59f","Type":"ContainerStarted","Data":"9d12c999add6dcb4fdb80ded541946293d2827d7d02c04f66cb1aa5f5ad38c1f"} Jul 21 09:04:55.024290 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:55.024250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5xdqm/must-gather-5494d" event={"ID":"7f056744-4cb2-42e3-9b28-3457e5e7f59f","Type":"ContainerStarted","Data":"36386a6e095ebfdb446537c6fcd87550b222ad5bdad1bf3d6016301044338104"} Jul 21 09:04:55.042330 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:55.042269 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5xdqm/must-gather-5494d" podStartSLOduration=2.141274145 podStartE2EDuration="3.042246912s" totalImagesPullingTime="900.972767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 09:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:04:55.039816778 +0000 UTC m=+629.393148000" watchObservedRunningTime="2026-07-21 09:04:55.042246912 +0000 UTC m=+629.395578134" Jul 21 09:04:55.394322 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:55.394292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rzw7k_a5e94215-cf73-44e4-94fa-9f7e2ea1156b/global-pull-secret-syncer/0.log" Jul 21 09:04:55.444565 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:55.444534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" Jul 21 09:04:55.530959 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:55.530931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-156.ec2.internal_07256174ce2a892eccda8c227b08f27a/haproxy/0.log" Jul 21 09:04:57.976444 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:57.976387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:58.077300 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:58.077266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwrx2_f70d8e58-33e4-4238-83c8-b9d1f9ec8d4a/konnectivity-agent/0.log" limit=1024 Jul 21 09:04:59.305394 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.305359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/alertmanager/0.log" Jul 21 09:04:59.333349 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.333325 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/config-reloader/0.log" Jul 21 09:04:59.359503 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.359448 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/kube-rbac-proxy-web/0.log" Jul 21 09:04:59.389519 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.389486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/kube-rbac-proxy/0.log" Jul 21 09:04:59.415942 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.415885 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/kube-rbac-proxy-metric/0.log" Jul 21 09:04:59.445687 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.445659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/prom-label-proxy/0.log" Jul 21 09:04:59.474445 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.474409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_199cdc15-a28e-4812-a130-21865cb957fb/init-config-reloader/0.log" Jul 21 09:04:59.549408 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.549337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7bgr_688d8a27-3b0f-400b-9b2a-c748eb9ea5c5/kube-state-metrics/0.log" Jul 21 09:04:59.574493 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.574425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7bgr_688d8a27-3b0f-400b-9b2a-c748eb9ea5c5/kube-rbac-proxy-main/0.log" Jul 21 09:04:59.603798 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.603772 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7bgr_688d8a27-3b0f-400b-9b2a-c748eb9ea5c5/kube-rbac-proxy-self/0.log" Jul 21 09:04:59.637006 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.636967 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5694b6c85d-6dgrc_e3f68f96-980d-411c-b056-f2bb8acfd950/metrics-server/0.log" Jul 21 09:04:59.672110 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.672027 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-xtjhv_f27b019b-88ca-48d0-866d-ae52269afcbd/monitoring-plugin/0.log" Jul 21 09:04:59.865339 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.865309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnm89_88c4f6e1-754c-4ca5-8f00-d230dedbb20c/node-exporter/0.log" Jul 21 09:04:59.892068 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.892036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnm89_88c4f6e1-754c-4ca5-8f00-d230dedbb20c/kube-rbac-proxy/0.log" Jul 21 09:04:59.922691 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.922665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnm89_88c4f6e1-754c-4ca5-8f00-d230dedbb20c/init-textfile/0.log" Jul 21 09:04:59.953428 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.953393 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tppvm_f826b168-a640-4d08-87de-cda8d3d0202c/kube-rbac-proxy-main/0.log" Jul 21 09:04:59.978369 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:04:59.978337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tppvm_f826b168-a640-4d08-87de-cda8d3d0202c/kube-rbac-proxy-self/0.log" Jul 21 09:05:00.009054 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.009024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-tppvm_f826b168-a640-4d08-87de-cda8d3d0202c/openshift-state-metrics/0.log" Jul 21 09:05:00.055374 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.055347 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/prometheus/0.log" Jul 21 09:05:00.088186 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.088158 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/config-reloader/0.log" Jul 21 09:05:00.118101 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.118022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/thanos-sidecar/0.log" Jul 21 09:05:00.143131 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.143069 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/kube-rbac-proxy-web/0.log" Jul 21 09:05:00.170587 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.170559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/kube-rbac-proxy/0.log" Jul 21 09:05:00.198950 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.198923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/kube-rbac-proxy-thanos/0.log" Jul 21 09:05:00.225212 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.225186 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cac5f9fb-4090-46e4-86b2-fca4a8fec64a/init-config-reloader/0.log" Jul 21 09:05:00.263559 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.263532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ldlgd_2fea3c83-7de0-46d5-9f25-bcea09a2d24e/prometheus-operator/0.log" Jul 21 09:05:00.284645 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.284621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ldlgd_2fea3c83-7de0-46d5-9f25-bcea09a2d24e/kube-rbac-proxy/0.log" Jul 21 09:05:00.315032 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.314997 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-htnwb_6e3bd050-c823-4e5f-abab-2842218be495/prometheus-operator-admission-webhook/0.log" Jul 21 09:05:00.477586 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.477492 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/thanos-query/0.log" Jul 21 09:05:00.504304 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.504277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/kube-rbac-proxy-web/0.log" Jul 21 09:05:00.531818 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.531449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/kube-rbac-proxy/0.log" Jul 21 09:05:00.556349 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.556310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/prom-label-proxy/0.log" Jul 21 09:05:00.580533 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.580502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/kube-rbac-proxy-rules/0.log" Jul 21 09:05:00.604413 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:00.604341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-749558d878-86tl9_917e0ea7-bff9-4d4a-8ef3-2a91c63d3e0b/kube-rbac-proxy-metrics/0.log" Jul 21 09:05:02.960880 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:02.960847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-2zcp8_3f94ae41-fbf0-4683-a7cc-0efcedaa33c9/download-server/0.log" Jul 21 09:05:03.182904 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.182866 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv"] Jul 21 09:05:03.187317 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.187290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.197219 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.197186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv"] Jul 21 09:05:03.277609 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.277516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8v4f\" (UniqueName: \"kubernetes.io/projected/875e87df-5244-4494-b2ce-66216d03c3f6-kube-api-access-g8v4f\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.277609 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.277572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-sys\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.277843 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.277791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-proc\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.279591 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.278032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-lib-modules\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.279591 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.278193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-podres\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379388 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-lib-modules\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379568 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-podres\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379568 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8v4f\" (UniqueName: \"kubernetes.io/projected/875e87df-5244-4494-b2ce-66216d03c3f6-kube-api-access-g8v4f\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379568 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-sys\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379568 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-proc\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379568 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-lib-modules\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379828 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-podres\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379828 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-sys\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.379828 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.379635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875e87df-5244-4494-b2ce-66216d03c3f6-proc\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.388247 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.388222 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8v4f\" (UniqueName: \"kubernetes.io/projected/875e87df-5244-4494-b2ce-66216d03c3f6-kube-api-access-g8v4f\") pod \"perf-node-gather-daemonset-vvpbv\" (UID: \"875e87df-5244-4494-b2ce-66216d03c3f6\") " pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.502853 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.502810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:03.676109 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:03.676078 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv"] Jul 21 09:05:03.678810 ip-10-0-128-156 kubenswrapper[2576]: W0721 09:05:03.678780 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod875e87df_5244_4494_b2ce_66216d03c3f6.slice/crio-abff6aae73b3cc24c392b835633185647a3129c5b5702f3d7125cef725de11b4 WatchSource:0}: Error finding container abff6aae73b3cc24c392b835633185647a3129c5b5702f3d7125cef725de11b4: Status 404 returned error can't find the container with id abff6aae73b3cc24c392b835633185647a3129c5b5702f3d7125cef725de11b4 Jul 21 09:05:04.085248 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.085211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" event={"ID":"875e87df-5244-4494-b2ce-66216d03c3f6","Type":"ContainerStarted","Data":"fa4d410faedd919b2173942b2dfb3dfd5496215f3104e7acc18a692724a09bc3"} Jul 21 09:05:04.085638 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.085268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" event={"ID":"875e87df-5244-4494-b2ce-66216d03c3f6","Type":"ContainerStarted","Data":"abff6aae73b3cc24c392b835633185647a3129c5b5702f3d7125cef725de11b4"} Jul 21 09:05:04.085638 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.085344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:04.102655 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.102605 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" podStartSLOduration=1.102585548 podStartE2EDuration="1.102585548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 09:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:05:04.101869663 +0000 UTC m=+638.455200884" watchObservedRunningTime="2026-07-21 09:05:04.102585548 +0000 UTC m=+638.455916774" Jul 21 09:05:04.381754 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.381668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vhgd_29d688b7-4dfc-42b7-ab3c-fff35929c8d9/dns/0.log" Jul 21 09:05:04.418088 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.418047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vhgd_29d688b7-4dfc-42b7-ab3c-fff35929c8d9/kube-rbac-proxy/0.log" Jul 21 09:05:04.564228 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:04.564203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24cjn_86792249-1749-49e4-bd3c-6f255161222e/dns-node-resolver/0.log" Jul 21 09:05:05.121494 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:05.121466 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lgdbb_f2d9e81b-15cc-438f-bf6f-481e73d81bd6/node-ca/0.log" Jul 21 09:05:06.209058 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:06.209027 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gs9pd_33fbe434-8225-4bb5-81f2-8f1eec91fc40/serve-healthcheck-canary/0.log" Jul 21 09:05:06.728291 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:06.728261 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbdxv_a787559b-1dcd-4df3-b3b7-8be95dd15210/kube-rbac-proxy/0.log" Jul 21 09:05:06.752481 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:06.752455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbdxv_a787559b-1dcd-4df3-b3b7-8be95dd15210/exporter/0.log" Jul 21 09:05:06.778242 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:06.778218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbdxv_a787559b-1dcd-4df3-b3b7-8be95dd15210/extractor/0.log" Jul 21 09:05:10.100736 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:10.100707 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5xdqm/perf-node-gather-daemonset-vvpbv" Jul 21 09:05:13.428904 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.428874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-85lxm_093f1d45-d527-469b-8889-745344efdda3/kube-multus/0.log" Jul 21 09:05:13.478675 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.478646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/kube-multus-additional-cni-plugins/0.log" Jul 21 09:05:13.538260 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.538230 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/egress-router-binary-copy/0.log" Jul 21 09:05:13.583713 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.583685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/cni-plugins/0.log" Jul 21 09:05:13.641142 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.641111 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/bond-cni-plugin/0.log" Jul 21 09:05:13.673028 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.673005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/routeoverride-cni/0.log" Jul 21 09:05:13.697168 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.697098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/whereabouts-cni-bincopy/0.log" Jul 21 09:05:13.723911 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:13.723878 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnx69_db4a4f92-dcca-4d62-8c70-57127b6db266/whereabouts-cni/0.log" Jul 21 09:05:14.446780 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:14.446751 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6r9s8_9e8ecde8-6fc0-4972-ab08-80b400b7c794/network-metrics-daemon/0.log" Jul 21 09:05:14.486097 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:14.486072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6r9s8_9e8ecde8-6fc0-4972-ab08-80b400b7c794/kube-rbac-proxy/0.log" Jul 21 09:05:15.391386 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.391358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/ovn-controller/0.log" Jul 21 09:05:15.413130 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.413104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/ovn-acl-logging/0.log" Jul 21 09:05:15.438443 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.438417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/kube-rbac-proxy-node/0.log" Jul 21 09:05:15.468618 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.468593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 09:05:15.493421 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.493387 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/northd/0.log" Jul 21 09:05:15.518888 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.518868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/nbdb/0.log" Jul 21 09:05:15.543185 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.543144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/sbdb/0.log" Jul 21 09:05:15.586588 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:15.586546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dkcr7_e73f622b-7eaf-407c-9180-9266216c0b08/ovnkube-controller/0.log" Jul 21 09:05:17.109948 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:17.109919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-clwbz_edac258e-34fe-4970-9ad6-4d5ac958a4e5/network-check-target-container/0.log" Jul 21 09:05:18.161589 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:18.161564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-l5k79_9ff8a342-acd8-4a00-9c85-fc0b76d3198e/iptables-alerter/0.log" Jul 21 09:05:18.796756 ip-10-0-128-156 kubenswrapper[2576]: I0721 09:05:18.796731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hkk89_bd96e20f-ab6d-48cc-87b6-02e8acc27d07/tuned/0.log"